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FOREWORD 


The  Walter  Reed  Army  Institute  of  Research,  Walter  Reed  $rmy 
Medical  Center  served  as  the  host  for  the  Eighth  Conference  on  the 
Design  of  Experiments  in  Army  Research,  Development  and  Testing. 
This  Washington,  D„  C.  Conference  was  held  24-26  October  1962. 
Colonel  Conn  L.  Mil  burn,  Jr.  ,  Director  of  WRAIR,  issued  the  fallowing 
jltjitter  to  those  attending1  this  scientific  meeting:  ,  }  i! 

i|  "The  staff  and  faculty  of  the  Institute  feel  privileged  and  honored 
that  Walter  Reed  Army  Institute  of  Research  has  been  selected  ail  the 
•Mace  for  this  Eighth  Conference  on  the  Design  of  Experiments  in'iArmy 
Research,  Development  and  Testing.  To  each  of  you1  we  extend  a  moat 
ibordial  welcome,  /  >  \. 

•  .  ‘  /•  ••  •  ' 

It  Is  a  pleasure  to  have  you  with  ua  and  we  sincerely  hope  that  your 
f  stay  here  will  be  both  enjoyable  and  professionally  rewarding.  " 


The  Army  Mathematics  Steering  Committee  takes  this  opportunity  to 
thank  Colonel  Milburn  for  his  welcoming  remarks  and  for  the  use  of 
the  excellent  facilities  under  his  command.  The  thanks  of  the  Committee 
i  are  also  due  to  the  two  Local  Chairmen*  Lt.  Col.  JStefano  V'ivona  and 

£  Major  Paul  J.  Wentworth,  appointed  by  him,  for  theirvery  efficient 

I  y  handling  of  all  local  arrangement^.  I  .  „ 

i  'll-  '  -  •  V. 

The  following  information  about  the  host  installation  was  extracted, 

■i  with  minor  altosjations,  from  the  Medical  Annals  of  the  District  of 

Columbia,  Vol  XXX,  No.  11,  November  1961. 

V 

5'  '  .  .  ■  "  vi'  \> 

[  .  HThe  Walter  Reed  Army  Institute  of  Research  (WRAIR)  was  founded  | 

in  1892  as  the  Army  Medical  School,  the  first  school  of  preventive  medi¬ 
cine  in  the  United  States.  The  school  was  established  by  Surgeon  General 
George  Ml  Sternberg,  one  of  the  great  military  men  of  science,  thus 
j,  “bringing  to  fruition  an  idea  first  proposed  by  Surgeon  General,  William  A, 

f  Hammond  in  1862.  On  General  Sternberg's  recommendation  liha  War 

Department  issued  General  Orders  No.  01,  dated  24  June  1893,  founding  ‘ 
.the  school. 


Captain  (later  Major)  Walter  Reed,  in  whose  honor  the  Army  Medical 
Center  is  named,  was  a  member  of  the  first  faculty.  Captain  Reed  was 
Professor  of  Clinical  and  Sanitary  MicroBcopy  and  Director  of  the  Patho¬ 
logical  Laboratory.  He  was  also  the  first  Secretary  of  the  Faculty. 
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The  Army  Medical  School  marked  its  fifth! eth  anniversary  on 
18  December  19431with  graduation  exercises  for  the  class  completing 
courses  in  military  and  tropical  medicine.  The  class  of  1?4  included 
medical1  officers  from  the  armies  of  the  United  States ,  Canada,  and 
Peru,  and  officials  of  state  health  departments.  An  honored  guest  a|., 
the  exercises  was  Colonel.  Deane  C,  Howard,  retired,  j  who  he|d  the' 
highest  rating  in  the  first  class  graduated  from  the  Army  Medical  l! 
School  in  1894. 

Since  World  War  lithe  School  has  changed  its  name  several  times. 
The  name,  Army  Medical  Department  Research  and  Graduate  School, 
was  adopted  in  1947.  This  was  changed  to  The  Army  Medical  Service 
Graduate  School  in  1950  and  finally ,  in  1955,  the  present  name,  The 
V/ alter  Reed  Army  Institute  of  Riisearph,  was  adopted. 

The  bs^sic  mission  of  the  Walter  Reed  Army  Institute  of  Research 
is  'To  provide  the  medical  research  aid  professional  graduate  training 
required  by  the  Army  to  fulfill  its  role  In  the  national  defense.  1  Actually, 
this  broad  mission  is  divided  into  4  parts:  (1)  serving  as  a  research 
and  development  center,  (2)  providing  education  and  training (jto  officers 
of  the  Army  Medical  Service  (also  to  some  officers  from  oith^r  branches 
of  the  Armed  Forces  and  from  other  countries  and  some  civilians), 

(3)  serving  as  a  central  reference  laboratory  for  the  Army  Medical 
Service  and,  in  a  number  of  fields,  for  the  Navy,  Air  Force  and  Veterans 
Administration,  and  (4)  manufacturing  more  than  100  biological  prcSducls, 
not  obtainable  through  commercial  sources,  which  are  supplied  to' 
the  Armed  Forces  and  the  Veterans  Administration, 

'(  The  first  class  began  on  1  November  1893  with  5  studentsi;officially 
enrolled.  From  this  small  beginning  the  original  Army  Medical  School 
has  grown  into  the  present  great  Institute  of  Research  whose  activities 
cover  all  parts  of  the  world.  11 

At  the  Eight  Conference,  invited  addresses  were  delivered  by 
Drs.  Robert  P,  Abelson,  Herbert  G.  Batson,  Hernian  Chernoff,  Egon 
3,  Pearson,  and  Marvin  A,  Schneiderman.  Decisions  under  uncertainty, 
bio-assay,  optimal  designs,  assessing  optimal  performance  of  weapons', 
screening  theory  were,  respectively,  the  areas  discussed  by  these  five 
specialists,  Dr;.  Harold  F.  Dorn  served  as  Chairman  for  the  Panel  Dis¬ 
cussion  tin  Diet  and  Heart.  Disease.  Dr.  George  V.  Mann  initiated  the 
Panel  Discussion  by  presenting  data  and  known  facts  about  diet  and  heart 
diseases.  Mr.  Jerome  Cornfield  commented  on  the  material  presented 
by  Mann;  then  he  and  the  Chairman  led  the  discission  and  answered 


iii. 


questions’ by  members  of  the  audience.  Miss  Beatrice  Orleans  showed 
and  discussed  a  film  on  the  Design  of  Experiments.  Two  other  important 
parts  of  the  conference  were  the  three  papers  discussed  in  the  Clinical 
'Sessions,  and  the  twenty-six  papers  delivered  in  the  Technical  Sessions. 

The  present' volume  of  the  Proceedings  contains  twenty-eight  papers 
which  were  presented  at  this  meeting.  The  Army  Mathematics  Steering 
GoSnpmittfee,  the  sponsor  of  this  series  of  conferences^  has  asked  that 
the'se  articles  qn  modern  statistical  principles  in  the  Design  of  Experi¬ 
ments,  as  well  as  certain  applications  of  these  ideas,  be  made  available 
ih  the  form  of  these  Proceedings, 

The  Eighth  Conference  was  attended  by  registrants  ancl  participants 
fr4>m  over  80  different  organizations.  Speakers  and  panelists  came  from. 
Bcjioz-Allen  Applied  Research,  Inc.;  Bureau  of  Ships;  C-EaI-R,  Inc.; 

Ford  Motor  Co.  ;  Iowa  State  University  of  Science  and  Technology;  National 
Bureau  of  Standards;  National  Cancer  Institute,  N1H;  National  Heart  Insti¬ 
tute,  NIH;  North  Carolina  State  College;  Operations  Research,  Inc;.; 
Pxjinceton  University;  Research  Analysis  Corporation;  Research  Triangle 
Institute;  Stanford  University;  University  College,  London;  University  of 
Illinois,  College  of  Medicine;  University  of  Michigan  Institute  of  Science 
and  Technology;  University  of  North  Carolina;  University  of  Wisconsin, 

U.  S.  Army  Mathematics  Research  Center;  Vanderbilt  University;  Virginia 
Polytechnic  Institute;  Yale  University,  and  thirteen  Army  Facilities. 

I  I*  i'  . 

Before  closing,  the  Chairman  wishes  to  express  his  sincere  thanks  to 
his  Advisory  Committee;  F.  G.  ,Dressel  (Secretary),  Fred  Frishman, 

B.  G.  Greenberg,  Frank  E.  Grubbs,  Boyd  Harshbarger,  H.  L  Lucas,  Jr.  , 
Clifford  J.  Maloney,  Lt.  Col.  S$ephano  Vivona,  and  Marvin  Zelen  for  their 
suggestions  fnd  assistance  in  selecting  the  invited  speakers  and  formalizing 
the  plans  for  this  conference.  1*he  Chairman  is  especially  grateful  to 
Dfe.  Dressel  for  coordinating  the;  Conference  program  and  seeing  these 
Proceedings  through  publication;  S 

J  I  '  !'  I  :■ 

\  S.;'S.  Wilks  . 

Pa:ofessor  of  Mathematics.;. 

Princeton  University 
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0930-1215  GENERAL  SESSION  I 

Sternberg  Auditorium 

Calling  of  Conference  to  Order 

Lt«  Colonel  Stefano  Vivona,  Local  Chairman 

•i 

Welcome  to  Walter  Reed  Army  Medical  Center 
Major  General  A.  L,  Tynes,  Commanding 

Welcome  to  Walter  Reed  Army  Institute  of  Research 
Colonel  Conn  t>.  Milburn,  Jr, ,  Commanding 

Announcements 

Major  Paul  J,  Wentworth,  Chairman,  on  Local 
;  Arrangements 


Chairman]  Dr.  Churchill  Eisenhart,  Statistical  Engineering 
Laboratory,  National  Bureau  of  Standards 

A  Statistician's  Place  in  Assessing  the  Likely  Operational 
Performance  of  Army  Weapons  and  Equipment 

Professor  Egon  S.  Perfrson,  University  College,  London 


A  General  Survey  of  Screening  Theory  ,, 

Dr,  Marvin  A,  Schnaiderman,  National  Cancer  Institute, 
**  *  *  #  *«  «  •« 
jmiuoam  mautuian  ui  noaibn 


IE20-1320  LUNCH  -  Ball  r*  Q  Q>1  Y\  f 


Officsts*  Opayii  MssSi 


WRAMC 


Technical  Sessions  I  and  II  as  well  as  Clinical  Session  A  will  start  at 
1330,  After  the  coffee  break  Technical  Session  HI  and  l'V  will  convene  and 
run  from  1510-1700.  Starting  at  1700  therq  will  be  a  Social  Hour.  This 
will  provide  an  opportunity  for  old  friends  to  get  together  and  for  new  friends 
to  get  acquainted.  We  hope  that  everyone  at  the  conference  will  be  able  to 
.stay  for  this  phase  of  the  meeting. 
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1330-1440  TECHNICAL  SESSION  I  -  Sternberg  Auditorium 

n 

j  Chairman:  Sidney  Sobelman,  U.  S.  Army  Munitions  Command, 

Picatinny  Arsenal 

Estimation  of  Service  Life  from  Fatigue  Testing  Results  on 
Full  Scale  Specimens 

John  P,  Purteii,  Research  and  Engineering  Division, 
Watervliet  Arsenal 

The  Simulated  versus  National  Environment  in  Military 
Testing  and  Operations 

C.  Bruce  Lee,  Systems  Analysis  Section,  Advanced  Design 
Branch,  Research  U  Engineering  Directorate,  Ordnance 
i  Tank -Automotive  Command,  Center  Line,  Michigan 
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Application  of  2®"^  Fractional  Factorials  in  Screening  of 
Variables  Affecting  the  Performance  of  Dry  Process  Zinc 
Battery  Electrodes 

Nicholas  T,  Wilburn,  0.  S.  Army  Electronics  R  It  D 
Laboratory,  Fort  Monmouth,  New  Jersey 


Applications  of  the  Calculus  for  Factorial  Arrangements 
B.  Kurkjian,  Diamond  Ordnance  Fuse  Laboratories 
i,  M,  Zelen,  U.  S.  Army  Mathematics  Research  Center, 

;  University  of  Wisconsin  ■;  I 

/  ■  |  !i  j 

1330-1440  CLINICAL  SESSION  A  -  Room  341  j 

Chairman!  Frank  E.  Grubbs,  Ballistics)  Research  Laboratories 

Panelists:  W.  T,  Federer,  U,  S,  Army  Mathematics  Research 
i  ■  !  Center,  The  University  of  Wisconsin 

j  .  B.G,  Greenberg,  The  University  of  North  Carolina 

H,  O.  Hartley,  Iowa  State  University  of  Science  It 
!|  Technology  j' 

I!,L,  Lucas.  North  Carolina  Stata  Cnlinan 

M,  A,  Schneiderman,  National  Institutes  of  Health 
Statistical  Procedures  for  the  Evaluation  of  Thrust  Curves 
faui  (J,  Cox,  "White  Sand  Missile  Range,  New  Mexico 
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1510-1700  TECHNICAL,  SESSION  III  -  Room  341 

Chairman:  Gerhard  J.  Isaac,  U.  S.  Army  Medical  Research 
and  Nutrition  Laboratory,  Denver,  (Colorado 

The  Independent  Action  Theory  of  Mortality  a«  Tested  at 
Fcrt  Detrick  ' 

Francis1' M.  Wadley,  U,  S,  Army  Biological  Laboratories, 
Fort  Detrick,  M&ryland 

Trial  and  Station  Variability  in  P32  for  Tripartite  Collaborar 
tiohs 

Walter  D.  Foster,  U.S.  Army  Biological  Laboratories, 

Fort  Detrick,  Maryland 

Design  and  Analysis  cf  Entomological  Field  Experiment* 

William  A,  Brown,  Dugway  Proving  Ground,  Dugway,  Utah 
Scott  A.  Krane,  C-E-I-R,  Inc,,  Dugway  Field  Office, 

Dugway,  Utah  5 

1510-1700  TECHNICAL  SESSION  IV  -  Sternberg  Auditorium 

Chairman:  Vaughn  Le  faster,  Ammunition  Procurement 
and  Supply  Agency 

■  ■  (  .  r  •  . 

Comparison  of  Two  Approaches  to  Obtaining  a  Transformation 
Matrix  Effecting  a  Fit  to  a  Factor  Solution  Obtained  in  a  Dif¬ 
ferent  Sample  / 

Cecil  D,  Johnson,  U.S,  Arniv  Personnel  Research  Office 

Some  Least  -Squares  Transformations  of  Regression  Esti¬ 
mators  of  Orthogonal  Factors 

Emil  F.  Heermann,  U.S.  Army  Personnel  Research  Office 

A  Reliability  Test  Method  for  "One-Shot"  Items  ' 

H.  J.  Langlie.,  Aeron.utroni.es  Division,  Ford  Motor  Coftnpany 
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Thursday,  25  October 


Technical  Session  V  and  VI  will  be  held  from  0800 -0920,  Clinical 
Session  B  and  Technical  Session  VII  will  be  in  order  from  0950-1120, 

The  first  paper  in  Clinical  Session  B  carries  a  classification  of  SECRET 
and  the  second  paper  a  classification  of  CONFIDENTIAL.,  General 
Session  2  will  start  at  1130.  After  lunch  Technical  Session  VII  and  IX 
will  convene  at  1330  and  end  at  1440,  The  Panel  Discussion  on  Diet  and 
Heart  Disease  is  scheduled  to  start  at  1510.  A  film  entitled  "The  De¬ 
sign  of  Experiments"  will  be  shown  following  the  panel  discussion. 

0800-0920  TECHNICAL  SESSION  V  -  Sternberg  Auditorium 

Chairman:  Ralph  Brown,  U,  S.  Army  Materiel  Command 
Frankford  Arsenal 

Investigation  in  Temperature  Control  of  Hydraulic  Systems 
in  Rough  Terrain  Fork  Trucks 

Irving  Tairiow,  Quartermaster  Research  and  Engineering 
Command,  Natick,  Massachusetts 


Precision  of  Simultaneous  Measurement  Procedures 
W,  A.  Thompson,  Jr.,  University  of  Delaware  and 
National  Bureau  of  Standards 


0800-0920  TECHNICAL  SESSION  VI  -  Room  341  f 

Chairman:  B<!G.  Greenberg,  The  University  of  Ndrth  Carolina 

The  Ultraviolet  Microscopy  of  Tissues 

George  I.  Lavin,  Ballistic  Research  .Larobatories, 
Aberdeen':  Proving  Ground,  Maryland 

Redundancies  ilia  Hainan  Biomechanics  and  their  Application 
in  Assessing  Military  Man-Task  Disability  Performance  Re¬ 
sulting  from  Ballistic  Agents 

i'  William  lb  Kirby,  Ballistic.  Research  Laboratories, 

|  Aberdeen  ^rovjng  Ground,  Maryland 
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0950-1120  TECHNICAL  IeSSION  VII  -  Rnnm  3 « A 

Chairman:  Pau’  C,  Cox,  White  Sands  Missile  Range 


Half-Normal  irtotfl  for  Multi-Level  Factorial  Experiments 
Scott  A,  Krane,  C-E-I-R,  Inc. ,  Dugway  Field  Office, 
Dugway  Proving  Ground,  Dugway,  Utah 


Proportional  Frequency  Designs 

Sidney  Addelmann,  Statistics  Research  Division, 
Research  Triangle  Institute 
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0950-1120  CLINICAL  SESSION  B  -  Room  341 

Chairman:  Clifford  J.  Maloney,  National  Institutes  of  Health 

Panelist*:  0„  P.  Bruno,  Ballistics  Research  Laboratories 

Boyd  Harshbarger,  Virginia  Polytechnic  Institute 
8..S,  Wilks,  Princeton  University 
'  Marvin  Zelen,  U.  S.  Arnly  Mathematics  Research 
Center,  The  University  of  Wisconsin 

Security  Classification:  SECRET 
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Design  of  an  Experiment  to  Evaluate  Aerosol  and  Storage 
Characteristics  of  a  Viral  Slurry 

Samuel  N.  Metcalfe,  U.S.  Army  Biological  Laboratories, 
Fort  Detrick,  Maryland 

Bertram  W,  Haines,  U.S.  Army  Biological  Laboratories, 
Fort  Detrick,  Maryland 

Security  Classification:  CONFIDENTIAL 

Sensitivity  Analysis  of  Outputs  from  a  Computer  Simulation 
Model  of  a  Chemical  Weapons  System 

Reynold  Greenstone,  Operations  Research,  Inc. , 

Silver  Spring,  Maryland  i 

Ira  A,  DeArmon,  U.  S,  Army  CBR  Agency,  Operations 
Research  Group,  Army  Chemical  Center,  Maryland 
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1 130*1230  GENERAL  SESSION  2  -  Sternberg  Auditorium 

Chairman;  Fred  Friehman,  Army  Research  Office,  Office, 
Chief  of  R  &  D  •  il  .f  . 

Optimal  Design  of  Experiments  [  ' 

Professor  Herman  Chernoff,  Stafford  University 
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1230-1330  LUNCH  -  Ballroom,  Officere'  Open  Mess,  WRAMC 
1330-1440  TECHNICAL  SESSION  VIII  -  Room  34J;  i 

Chairman:  Ira  A,  DeArmon,  Jr,,  Opt: rations  Research  Group, 
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Vibration  Experiments 

F.  Pradko,  Dynamic  Simulations  Laboratory,  U.S.  Army 
Ordnance  Tank-Automotive  Command 

Si*e  Effects  in  the  Measurement  of  Soil  Strength  Parameters 
B.  Hanamoto,  Land  Locomotion  'Lab,  Research  Division, 
Research  and  Engineering  Directorate.  ATAC 
Emil  H.  Jebe,  Institute  of  Science  &  technology,  The 
University  of  Michigan  ! 
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j:  Chairman;  Edwin  Cox,  Agriculture  Research  Service, 
Belt* villa,  Maryland 

Effectiveness  of  Certain  Experimental  Plans  Utilised  in 
Sc  ns  or  y  Evaluations  i?  ,,  \ 

J.  Wayne  Hamman  and  Jan  Eindhoven,  Quartermaster 
t  Food  and  Container-  Institute  for'  the  Armed  Forces, 
Chicago,  Illinois 
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An  Evaluation  of  Radiation-Processed  Foods  for  ths  Military 
illations 

|  Donald  M.  Boyd,  Research  Analysis  Corporation 

,;orr“  -  L°bb*  Aud“or‘um  ’ 

GENERAL  SESSION  1  -  Starnbarg  Auditorium 

Panel  Discussion1  on  Died  and  Heart  disease 

'i  Chairman;  Dr.  Harold  F.  Dorn,  Biomatrica  Research 
Branch,  National  Heart  Institute 


Panelists:  Dr.  Qeorge  V.  Mann,  School  of  Medicine, 

Vanderbilt  University:  ,  I  j  'i 

Mr.  Jeroms  Cornfield,  Biometrics  Research 
i|  Branch,  National  Heart  Institute  ■  ■  i;  ■ 

SPECIAL  SESSION  -  Sternberg  Auditorium 

Chairmen;  Beatrice  Orleans,  Bureau  of  Ships  ! 
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Friday,  26  October 

Technical  Sessions  X  and  XI  run  from  0800-1000. .  General  Session  4 
will  liitart  at  1030  and  end  at  1230.  After  the  lunch  hour  your  host  has 
planned  for  you  an  interesting  and  informative  tour. 


0800*1000  TECHNICAL  SESSION  X  -  Room  341 

Chairman!  Earl  Atwood,  Walter  Reed  Army  Institute  of  Research 

Some  Consequences  of  Some  Assumptions  with  Respect  to  the 
Physical  Decay  of  a  Chamber  Aerosol  Cloud 

Theodore  W.  Horner,  Booz -Alien  Applied  Research,  Inc., 
Bethesda,  Maryland 

The  Role  of  Intuition  in  the  Scientific  Method 

Nicholas  M,  Smith,  Research  Analysis  Corporation 

How  to  Design  War  Games  to  Answer  Research  Questions 
W.  L.  Pierce,  Research  Analysis  Corpdr&tion 

0800-1000  TECHNICAL  SESSION  XI  -  Sternberg  Auditorium 

Chairman:  H.L,  Lucas,  North  Carolina  State  College 

Evaluation  of  Performance  Reliability  .  j 

Seymour  K.  Einbinder,  Picatinny  Arsenal  [ 

Ingram  Olkin,  Stanford  University  i;i 

Evaluation  of  Various  Laboratory  Methods  for  Determining 
>  Reliability 

|  A,  Bulfinch,  Picatinny  Arsenal 


1000-1030  COFFEE  BREAK  -  Lobby  Sternberg  Auditorium 
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1Q30-1 2:30  GENERAL  SESSION  4  -  Sternberg  Auditorium 

Chairman;  Or,  S,  S.  Wilks,  Princeton  University 

An  Experimental  Design  for  Decisions  under  Uncertainty 
Dr,  Robert  P,  Abeioon,  Yale  University 

Bio-Assay 

Dr.  Herbert  C.  Batson,  University  of  Illinois, 
College  of  Medicine 
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Confidence  Intervale  for  Systems  Reliability 
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A  STATISTICIAN'S  PLACE  IN  ASSESSING  THE  LIKELY 
OPERATIONAL  PERFORMANCE  OF  ARMS'  WEAPONS  AND  EQUIPMENT 

| 

E,  S.  Pearson 

University  College,  London,  England 

THE  BACKGROUND  OF  THIS  PAPER.  It  has  been  a  special  honour  to 
receive  an  invitation  from  the  organisfng  committee  of  this  Conference  to 
make  t)?e  journey  from  England  and  to  address  you  today.  In  thinking  how 
I  could  best  repay  the  compliment,  it  ijeemed  to  me  that  I  should  look  for 
a  subject  in  illustrating  whicjh  I  could  fcraw  on  my  own  particular  exper¬ 
iences,  gained  ip  working  fojr  the  British  armed  services  both  during  and 
since  the  second  World  war.  From  I9lp9  to  .1946  I  was  attached  with  a 
number  of  members  of  the  University  Collage,  London  Statistics  Depart¬ 
ment,  to  the  British  Ordnance  Board,,  This  iu  an  organisation  of  some 
historic  interest  for  1  believje  its  foundation  can  be  traced  back  to  an 
appointment  made  in  1414,  the  year  before  the  Battle  of  Agincourt!  It  is 
now  concerned  with  certain  aspects  of  the  development  and  acceptance  of 
weapons  for  both  the  Army,  the  Navy  and  the  Air  Force.  Then,  for  some 
years  afijier  the  war,  1  was  a  member  of  the  Ordnance  Board  Anti-aircraft 
Lethality  Committee  and  very  recently  I  have  been  pulled  back  to  be  chair¬ 
man  of  aih  advisory  committee  concerned  with  the  general  problem  of 
assessment  in  connection  with  army  weapons  and  equipment, 


Mv  main  experience  was  with  the;  subject  which  has  been  described  as 
terminal  ballijitics  and  in  particular  iwith  the  lethal  effectiveness  of  anti¬ 
aircraft  fire.  We  were  concerned  ajiso  with  field  artillery  fire  and  with  the 
medium  and  si  nail  bombs  of  those  d£|ya,  in  so  far  as  fragmentation  of  the 
casing  rather  |than  blast  played  an  important  part  in  their  effectiveness. 

It  is  of  course  true  that  the  Weapons  and  the  army  requirements  of  15-&0 
years  ago  have-  been  to  a  largle  extent  out-dated,  but  if  I  make  my  main 
topic  today  a  piece  of  historical  recording,  it  is  because  I  believe  that  a 
number  of  general  principles  and  lessons  emerge  from  such  a  study  which 
aro  still  relevant  to  the  practice  of  experimentation  and  analysis  in  Army 


Research'  today. 


It  seemed  to  me  that  then  a  were  two  advantages  in  taking  illustrations 
from  World  War  II  experience.  In  the  first  place  I  could  speak  of  matters 
about  which  1  had  the  'feel*  from  first  hand  knowledge  and  so  perhaps  could 
be  more  interesting  as  Well  as  convincing  in  any  arguments  put  forward. 
Secondly,  it  was  easier  to  be  factual  without  running  into  the  danger  of 
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Design  of  Experiments 


first  some  account  of  the  difficulties  with  which  we  were  faced  in  the  years 
1939-45  in  constructing  a  model  which  could  be  used  to  help  determine  how 
to  improve  the  effectiveness  o,f  anti-aircraft  fire.  In  describing  this  pro¬ 
blem,  it  should  be  possible  tojxndicate  a  number  of  lessors  which  are  still, 
relevant  in  a  much  wider  field!  There  are  also  mafiy  points  of  difference 
which  it  will  be  instructive  to  jemp'nasise.  j,  5 

THE  STATISTICIAN’S  PLACE.  I  should  perhapi^j  confess  straight  away 
that  1  shall  say  very  little  about  statistics  or  about  what  is  commonly.  !i  \ 
thought  of  as  the  design  of  experiments.  To  this  exrent  you  may  think  ths.t  • 
the  leading  phrase  in  the  title  of  this  paper  is  misleading,  unless  you  inter¬ 
pret  the  words  in  the  personal  sense  as  referring  to  the  statistician  who  1 
is  giving  this  address!  But  there  is,  I  think,  a  point  here  which  I  shduljl  1 
like  to  make.  At  the  fourth  of  this  series  of  Conferences,  held  ! 

Dr.  A.  W.  Kimball  read  a  paper  with  the  titlq:  “Error*  of  the  3r  kind  in  j* 
statistical  consulting”;  In  this  he  discussed  and  illustrated  the  fault  of 
giving  a  perfectly  sound  statistical  answer  to  a  problem  which  Is  not  'the  • 
real  one  needing  solution.  |  | 

Many  of  igs  are  I  think  conscious  of  what  might  perhaps  be  called]  an  ; 
error  of  a  4  kind;  that  whichlthe  statistician  makes  Iwheri  he  allowsl  his 
interest  in  the  statistical  elements  of  a  problem  and  its  potential  foy  statis¬ 
tical  elegance  and  sophistication  to  obscure  what  shovlld  be  his  prin/ie  ■ 

objective,  the  solution, of  the  real  matter  at  Issue.  The  fault  is  not  so  much! 
that  wrong  statistical  methods  are  used  (Kimball's  3  |  kind  of  error)  but  \ 
that  the  situation  does  not  justify  the  use  of  any  refined  statistical  methods  ' 
at  all  until  tho  outstanding  problem  has  been  solved  of:  obtaining  data  which  , 
are  both  relevant  £lnd  reliable.  The  statistician,  indeed,  is  called  upon  to 
be,  a  scientist  in  the  fullest  sense  of  that  term--to  apply  scientific  method,  ! 
not  merely  statistical  techniques,  to  the  job  on  hand,  , 

.  J 

Wjhen  he  has  .completed  some  piece  of  mathematic*!1.!  or  arithmetical 
analysis,  he  needs  to  ask  himiielf  searchingly:  does  this  answer  make 
sense?  1  can  recall,  as  no  doubt  some  of  you  can  too,  war-time  reports  1 
which  appeared  both  in  my  country  and  in  containing  a  pratty  piece 

of  alge.  rAic  development  or  some  standard  analysis  of  variance,  the  con¬ 
clusions  from  which  obviously  did  not  make  sense.  Perhaps  such  reports 
from  youthful  enthusiasts  would  never  have  appeared  but  for  the  inevitable 
shortage  of  experienced  and  critical  supervision  in  rapidly  expanding 
organisations.  They  are  likely,  however,  to  discourage  the  idea  that 
mathematics  or  statistics  were  of  value  in  problems  of  weapon  development 
and  testing,  because  the  experienced  non- statistical  layman,  the  military 
or  naval  technical  officer  who  had  the  feel  of  the  problems,  could  see  at 
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once  that  the  data  would  not  bear  the  confident  interpretation  which  was 
often  placed  on  them, 

Certainly  in  my  own  experience  at  the  Ordnance  Board  it  was  the 
physical  difficulty  in  securing  meaningful  experimental  data  which  had 
always  to  be  faced.  There  was  very  little  opportunity  for  design  as  it  is 
understood  in  agricultural  or  biological  trials.  There  was  no  paramount 
function  for  the  application  of  advanced  statiotics- -we  used  to  say  that 
the  only  statistical  tools  which  were  needed  were  the  normal  distribution 
in  1,  2  and  3  dimensions,  the  Poisson  and  the  bionornial.  But  it  is  true  to 
say  that  the  statistician's  training,  with  the  understanding  which  should 
follow  of  the  meaning  of  variation  and  correlation,  of  randomness  and 
probability,  with  its  emphasis  on  the  importance  of  adopting  a  critical  j' 

outlook  on  as  sumptions --all  this  is  likely  to  provide  an  excellent  prepar¬ 
ation  for  the  kind  of  work  we  are  discussing,  but  on  one  essential  condi  - 
tion--that  the  training  haB  been  carried  out  in  conjunction  with  practical 
application  to  data  analysis,  The  trend  in  the  teaching  of  mathematical 
statistics  at  our  universities  today  is  often  increasingly  away  from  any 
reaT application  to. data. 

There  is  another  point  which  I  think  is  worth  emphasising.  One  of  the 
,  surest  ways  to  cure  the  statistician  from  any  tendency  to  over -sophistication 
is  to  arrange  that  he  is  present  at  experiments  or  trials,  the  data  from  ! 
which  he  is  to  use.  In  this  respect  we  wore  lucky  in  England;  we  attended 
faring  trials  on  the  Shoeburyness  Ranges,  we  were  hot  on  the  scene  afjier 
bpmbs  had  been  dropped  on  parked  aircraft,  trucks  and  Wooden  dummies 
ifl  slit  trenches  on  a  special  bombing  range  in  the1  New  Forest,  and- -as  a 
Wartime  experience--we  might  happen  to  be  present  at  a  gun-site  when 
fterman  aircraft  were  the  target.  Under  such  conditions  it  is  easier  to 
c|j>me  to  grips  with  the  meaning  and  limitations  of  data. 

THE  ANTI-AIRCRAFT  PROBLEM.  First  let  me  try  to  put  this  problem 
into  its  setting  of  20  or  more  years  ago.  As  far  as  the  Ordnance  Board 
ssroup  was  concerned,  we  had  not  to  consider  the  problems  of  the  deploy¬ 
ment  of  guns,  of  the  acquisition  of  targets,  of  the  handling  of  maBS  attacks 
or  other  important  tactical  matters.  These  were  questions  for  the  Anti¬ 
aircraft  Command  and  its  Operational  Research  Section  which  was  formed 
in  the  summer  of  1940.  Our  work  was  closely  related  to  the  question  of 
design,  to  understand  more  clearly  the  individual  relationship  between 
predictor,  gun,  shell,  fuze  and  enemy  target  in  order  to  advise  what 
improvements  were  possibie  and  iikeiy  to  be  worthwhile, 
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In  this  field\of  research  where  the  terminal  action  in  which  one  is 
interested  may  be  taking  place  several  thousand  feet  above  ground,  no 
overall  experiment  bringing  in  all  the  factors  concerned  is  conceivable; 
the  reasons  for  this  are  So  obvious  that  I  do  riot  need  to  list  them.  As  a 

'I 

consequence,  it  is  absolutely  essential  to  construct  a  mathematical  model 
of  the  terminal  engagement,  and  then  to  consider  how  the  parameters  of 
this  model  may  best  be  estimated.  As  in  so  many  other  problems  of 
military  science,  the  model  even  if  necessarily  simplified,  serves  as  an 
essential  means  of  defining  thfe  relationships fof  the  situation,  showing 
how  research  investigation  cap  be  broken  into  separate  pieces  and  em¬ 
phasising  at  Whal:  points  our  Dick  of  sure  information  is  greatest  and 
most  hampering. 

Let  me  now  outline  the  problem  and  its  solution  in  some  detail,  first 
describing  the  mathematical  model  and  then  discussing  the  three  main 
headings  under  which  gaps  in  knowledge  had  to  be  filled,  namely; 

I 

(i)  positioning  errors  (until  the  introduction  of  the  proximity  fuze  in 
1943-44  it  was  easy  tocombine  the  error  of  the  time  fuze  with  the 
predictor,  gun-iaying  and  ballistic  errors); 

(ii)  fragmentation  characteristics  of  the  shell; 

(iii)  target  vulnerability. 

The  difficulties  which  had  to  be  overcome,  largely  through  ignorance  of 
physical  properties  in  this  hitherto  unexplored  field,  are  I  think  sufficiently 
instructive  to  be  worth  including  as  part  of  the  story.  Much  the  same 
problems  were  I  'know  faced  later  on  (building  perhaps  on  our  experience) 
in  Section  T  of  the  Applied  Physics  Laboratory  at  Silver  Spring  and  the  „ 
associated  Proving  Ground  near  Albuquerque,  where  research  and  .trial 
work  was  carried  out  for  the  U.  S.  Navy,  I  did  not  myself  have  any 
direct  contact  with  U,  S.  Army  investigations. 

THE  MATHEMATICAL  MODE  I.  TV-»  firar  =  <mpUfied  model  which  was 
used  involved: 

(a)  A  three-dimensional  normal  distribution  of  positioning  errors 
about  the  target,  with  a  major  axis  aiong  the  shell  trajectory  and  the 
standard  errors  in  directions  perpendicular  to  this  axis  equal,  i.  e.  ,  the 
density  contours  were  taken  to  be  ellipsoids  with  circular  cross  sections 
in  planes  perpendicular  to  the  principal  axis. 
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Figure  1 


(b)  A  mail!  fragment  zone  lying  between  two  cones  whose  axio  was 
that  of  the  shell  axil)  and  the  trajectory  at  ,tl.me  of  burst,  and  a  small 
sudsidiarynose  oone, 
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The  density  of  fragments  within  the  main  zone  was  not  of  course 
uniform,  though  it  might  be  treated  as  such  f6r  a  first  approximation.  - 
For  any  zone  within  which  the  average  density  of  fragments  of  a  j- 

.given  penetrating  power  could  be  regarded  as  constant,  the  probability 
distribution  of  strikes  was  taken  as  Poisson*  f 

(c)  For  the  aircraft,  We  first  used  what  was  termed  an  'equivalent 
vulnerable  target*  represented  by  a  sphere  of  a  few  feet  in  radius  such 
that  its  'perforation'  by  at  least  one  'lethal1  shell  fragment  woulcl 
result  in  a  kill.  Later,  this  representation  had  to  be  treated  in  more 
detail. 

This  simple  model  baaed  on  the  trivariate  normal  and  the  Poisson 
distributions,  with  bounding  surfaces  consisting  of  ellipsoids,  cones 
and  spheres  was  amenable  to  computation,  provided  that  meaningful 
numerical  values  for  the  various  parameters  could  be  estimated. 

But  the  task  of  filling  in  these  unknown  elements  was  immense  and  for 
a  time  the  more  we  learnt,  the  more  we  realised  our  ignorance. 

Consider  then  some  of  the  gaps  to  be  filled, 

THE  POSITIONING  ERRORS.  The  original  data  were  collected  from 
Practice  Gamp  firings  at  towed  'sleeves',  using  kine -theodolites  to  ? 
measure  the  relative  position  of  shell  bursts  and  target.  This  was  much 
too  slow  a  target  and  the  Practice  Camp  computational  analysis  was  not 
very  accurate.  Later,  in  April  1940,  a  special  trial  of  predictor 
accuracy  was  staged,  following  a  free  flying  aircraft,  and  using  camera 
recordings  of  the  predictor  output  dials  synchronised  with  kine-theodo» 
liter  tracking  the  target.  However,,  when  German  aircraft  began  to 
come  over  England  later  in  1940,  it  was  at  once  clear  that  the  aiming 
errors  under  operational  conditions  were  much  greater  than  those 
estimated  from  trials.  We  were  up  against  the  problem  of  increased 
operator  inaccuracy  unde|r  stress, 

I  remember  P.  M.  S,  Blackett  (who  was  then  in  charge  of  the  newly 
formed  A.  A.  Command,  operational  Research  Group),  wondering 
after  watching  the  shell  bursts  in  the  night  , sky  and  a  searchlight-held 
enemy  aircraft,  whether  It  would  be  possible  to  determine  roughly  an 
operational  error  distribution  with  appropriate  photo-positioning 
equipment.  I  think  that  we  later  gave  up  all  hope  of  estimating  the 
actual  aiming  errors  under  operational  conditions  and  mad&  our  cal¬ 
culations  for  a  variety  of  different  error  combinations,  whilch  was 
ioften  all  that  was  needed  in  reaching  conclusions  about  the  Relative 
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merits  of  different  types  of  shell,  etc.  It  was  only  towards  the  end  of  the 
war  when  we  were  faced  with  that  ideal  straight-line -flying  target,  the 
VI  flying  bomb,  and  when  using  proximity  fuzes  that  a  rough  operational 
check  on  the  overall  adequacy  of  the  model  could  he  made, 

THE  FRAGMENTATION  PROBLEM.  Before  the  war,  the  standard 
trials  for  determining  the  fragmentation  ohayaoteri sties  of  shell  were; 

■■  ii  "  '  ■:  ■; 

(a)  Fragmentation  in  a  sand-bag  'befehive*  ,  the  shell  fragments  being 
recovered,  passed  successively  through  various  sizes  of  sieve  and  (above/ 
a  certain  minimum  size)  Counted  and  weighed, 

(b)  Trials  to  measure  the  dispersion  and  penetrating  power  of  frag« 
ments  by  detonating  the  shell  some  5  ft.  above  ground,  ih  asurround  of  V 
2-inch-thick  wooden  targets,  placed  in  a  semicircle  of,  say,  30,  60,  90 
or  120  ft.  radius.  The  detonation  was  either  at  rest  or  obtained  by  flrifig 
the  shell  with  appropriate  remaining  velocities  against  a  light  bursting 
screen. 


With  the  war-time  allocation  of  additional  scientific  effort  onto  weapon 
lethality  problems,  the  number  of  questions  which  were  posed  for  answering 
was  greatly  increased.  The  shell  and  bomb  fragment  attack  on  many  targets 
besides  aircraft  had  to  be  considered,  On  the  one  sidaiilt  was  necessary  to 
have  means  of  projecting  individual  fragments  of  various  sizes  at  known 
velocities,,  against  a  variety  of  targets.  On  the  other  ijj  was  important  to 
know  more  about  the  size -velocity -directional  pattefn  as  wall  as  the  jj 
retardation  of  the  fragments  projected  by  a  complete  a  Hell  buret  In  flight. 

As  soon  as  forward  planning  is  attempted  it  becomes  necessary  ti 
generalise  the  characteristics  of  a  weapon;  in  the  caee  of  A,  A,  shelijjthe 
ultimate  Objective  waa  to  be  able  to  predict  the  characteristics  of  the 
fragment  diet  ribution  from 


(1)  the  drawing  board  design, 

(ii)  a  knowledge  of  the  particular  explosive  filling  to  be  vised, 
and 

(iii)  for  any  desired  forward  velocity  of  the  shell. 
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It  became  clear  that  the  old  form  of  trials  mentioned  in  the  first  para¬ 
graph  of  this  section  was  inadequate.  When  shells  were  burst  in  flight  in 
a  wood  target  surround  the  re, suiting  pattern  of  perforations  could  not  be 
accurately  related  to  the  pattern  from  a  static  burst,  merely  by  adding 
this  component  forward  vsflocity  of  the  shell.  Nor  was  it  easy  to  link  the 
distribution  of  fragment  sizes  from  the  sand-bag  collection  with  the  number 
of  perforations  in  the  wood,  using  any  simple  assumptions  about  velocities 
and  retardations.  The  essential  need  was  for:. .mo re  basic  physical  experi¬ 
mentation;  without  this  w«  could  not  generalise. 

Here  we  were  lucky  in'gettlng  help  from  a  very  skilled  scientific  team 
at  out1  Safety  in  Mines  Research  Establishment  at  Buxton,  who  initiated  a 
programme  of  rea«arch.whlch  gradually  succeeded  in  disentangling  the 
picture.  Shells  on  which  Bmall  letters  were  engraved  in  successive  rings 
round  ;the  liir cumfajrence  were  fired  at  rest,  within  a  surround  of  straw- 
board,  against  w,hi()h  a  large  number  of  small  velocity  measuring  screens 
were  placed.  Fragments  subsequently  collected  and  weighed  could  be 
identified  with  a  particular  zone  of  the  shell,  and  velocities  estimated 
either  by  direct  measurement  or  more  crudely  from  depth  of  penetration 
into  the  strawboard. 

i  .  ,  ,  .  >  1 

It  then  became  clear  that  the  initial  velocity  of  fragments  varied 
very  considerably  with  the  part  of  the  casing  from  which  they  came  and 
similarly,  that  size  or  weight  also  varied  with  position.  To  some  extent 
this  initial  velocity  could  be  related  tq  the  charge/weight  ratio  of  the 
section,  of  the  shell  (perpendicular  16  its  axis)  from  which  the  fragments 
originated,  With  this  information,  we  began  at'last  to  get  a  surer  picture 
6f  how  fragments  would  be  projected  from  different  designs  of.shell 
detonated  at  any  given  velocity  in  free  air. 

1  It  should  be  noted  that  the  angle/of  the  fragmenj;  zone,  in  particular 
the  rather  sharply  defined  'cut-off  angle*  or  semi-vertical  angle  0  of  the 
backward  bounding  cone  of  my  Figure  2  became  particularly  important  with 
the  introduction  of  proximity  fuzes.  If  the  pattern  of  fuze  functioning  wag 
not  co-ordinated  with  that  of  fragmentation  the  shell  might  generally  burst 
in  positions  relative  to  the  target  such  that  fragments  were  bound  to  miss 
the  more  vulnerable  parts  of  the  aircraft,  i 

AIRCRAFT  VULNERABILITY.  In  the  earliest  trials  carried  out  shortly 
before  the  waif,  an  aircraft  and  an  arc  of  large  2-inch  thick  vertical  wooden 
screens  wereijplaced  beyond  and  on  opposite  sides  of  a  small  burster  screen 
at  which  the  ejhell  (with  percussion  fuze)  was  fired  at  a  proscribed  velocity. 
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It  was  in  this  way  possible  to  correlate  the  damage  done  to  the  aircraft 
with  the  density  of  fragments  which  perforated  two  inches  of  wood  in  a 
second,  similarly  constituted  fragment  stream.  By  noting  and  painting 
round  the  fragment  holes  after  each  round  was  fired,  the  same  target 
could  be  used  a  large  number  of  times,  varying  the  aspect  of  attack  and 
distance  of  detonation  as  desired.  ;  y 

It  was  from  the  observed  correlation  of  density  of  'through*1  (fragment 
capable  of  perforating  2  ins,  of  wood)  and  damage  that  it  was  possible  to 
introduce  into  the  model  calculations  a  simplified  'equivalent  vulnerable 
target'.  This  was  the  first  method  of  attack.  At  a  later  stage  after  experi¬ 
mental  techniques, had  become  more  refined  and  the  Royal  Aircraft  Establish¬ 
ment  assessors  more  experienced,  it  became  possible  to  dissect  the  problem 
still  further.  The  overall  vulnerability  picture  was  then  built  up  from 
;  information  gained  by  firing  from  high  velocity  barrels  individual  fragments 
of  predetermined  sixes,  housed  in  specially  designed  cups,  at  a  variety  of 
(aircraft  components,  which  were  screened  where  necessary  by aluminium 
plates  representing  wing  surfacee  or  fuselage.  '  N.. 

The  information  so  obtained  could  of  course  be  used  directly  both  in 
trying  to  draw  conclusions  about  optimum  fragment  sises  and  velocities 
and  in  considering  ways  of  improving  the  protection  of  our  o*W»  aircraft, 
Viewed  in  this  way  the  problem  may  not  appear  to  be  statistical  at  all, 
but  it  did  assume  a  statistical  character  as  soon  as  one  had  to  try  and  make 
Uses  of  this  Information  in  the  'model;',  with  its  shells  bursting  in  a  proba¬ 
bility  distribution  around  ap  aircraft  and  each  projecting  a  composite 
stream  of  fragments,  whose  frequency  distribution  of  strikes  on  equal  areas 
of  an  intervening  target  would  be  roughly  of  Poisson  form. 
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SOytE  CONCLUSIONS  DRAWN  FROM  THIS  SURVEY.  Looking  back  now 
after  ajnumber  of  years,!:  it  seems  to  me  that  by  .1944  we  had  really  broken 
the  back  of  the  problem.  It  became  possible  to  make  recommendations  with 
some  confidence  of  ft  number  of  matters;  on  the  optimum  design  character¬ 
istics  of  time  fuzed  and  of  proximity  fuzed  shell;  on  the  relative  importance 
of  case  thickness  and  explosive  filling;  on  what  might  be  achieved  by  using 
methods  to  control  the  size  of  fragments;  on  the  relative  gains  to  be  won  by 
improvement  in  fire  control  and  in  design  of  shell.  Few  such  questions 
could  have  been  answered  with  any  confidence  in  1939, 


It  is  of  course  a  truism  that  much  of  the  fundamental  research  bearing 
on  military  problems  is  only  rounded  off  when  it  is  becoming  too  late  to  be 
of  use  in  the  war  which  provided  the  stimulus  fji>r  the  effort;  and  by  the 
next  war,  the  whole  conditions  of  warfare  are  changed.  This  seems 
particularly  true  in  regard  to  the  ground-to-air  weapons,  But  I  think  that 
the  work  I  have  been  describing  brought  to  the  front  a  number  of  general 
principles,  a  sample  of  which  I  Will  bring  to  your  attention  in  concluding 
this  account.  '  ' 


The  ease  with  which  Important  factors  may  bo  overlooked.  A  common 
experience  when  the  human  mind  starts  to  investigate  the  unknown  is  the  , 
way  in  which  important  considerations  which  seem  so  obvious  afterwards 
are  only  realised  through  a  process  of  slow  and  perhaps  painful  discovery, 

(a)  We  did  not  for  long  appreciate  the  effect  of  ground  ricochet  in  our 
firing  trials.  The  influence  of  ricochet  and  other  factors  arising  from 
proximity  to  the  ground  on  the  directional  distribution  of  fragments  would 
be  natural  operational  effects  in  the  case  of  field  artillery  or  dropped 
bomba,  but  were  very  confusing  when  we  were  seeking  information  about  1 
the  character  jj>£  shell-bursts  thousands  of  feet  above  ground.  I know  that 
the  American  Experimenters  appreciated  this  effect  before  we  did  and  were 
the  first  to  introduce  ricochet  traps  into  A,  A.  shell  trials.  Perhaps  the 
most  convincing  demonstration  of  its  existence  which  1  recall  occurred 
when  we  burat  a  500  lb.  bomb  statically,  with  axis  inclined  at  30  to  the 
vertical,  The  target  screens  showed  a  striking  pattern  of  holes;  a  tilted 
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other  arm,  from  the  ground  ricochets.  As  long  as  bombs  or  shell  were 
burst  with  their  axes  horizontal  (nr  vertical),  the  effect  remained 
unnoticed, 


(b)  Again,  when  studying  the  size  distribution  of  fragments,  th'Se 
amount  of  secondary  break-up  on  striking  the  collecting  medium  after 
detonation,  was  only  realised  when  strnwboa.rd  was  used  in  place  of  sand 
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and  the  paths  of  these  pieces,  broken  on  .first  strike,  coxild  be  traced 
through  the  Successive  layers  of  board. 

(c)  Another  point  not  fully  appreciated  was  the  effect  of  emotional 
!j  stress  on  the  human  element  undeir  battle  conditions,  The  assessment  of 
'[its  magnitude,  especially  under  circumstances  and  conditions  which 
cannot  be  precisely  foretold,  is  one  of  the  hardest  problems  of  the 
moment, 

The  place  of  basic  research.  In  many  instances  it  may  not  be  too 
difficult  to  carry, out  a  realistic  trial  of  a  particular  weapon,  against  a 
given  target  under  specified  environmental  conditions.  But  a  more 
fundamental  knowledge  is  necessary  to  assess  the  performance  of  wea¬ 
pons,  perhaps  still  on  the  drawing  board,  under  a  wide  variety  of  condi¬ 
tions.  It  was  in  this  connection  that  the  detailed  experimental  work  on 
fragmentation  performed  to  laboratory  standards  was  essential,  even  If 
the  laws  of  initial  velocity,  of  size  distribution  and  of  retardation  which 
resulted  were  to  sbme  extent  empirical. 

The  valueof  having  something  up  your  sleeve,  Observation  of  the 
amount  of  the  metal  casing  which  appeared  to  be  broken  up  into  dust  or 
very  small  fragments*,  on  detonation,  suggested  that  the  destructive 
power  of  the  anti-aircraft  shell  might  be  considerably  increased  by 
‘controlling1  the  size  of  fragments.  It  was  over  this  matter  that  the  help 
of  the  Safety  in  Mines  Research  Establishment  was  first  called  on,  and 
by  the  end  of  the  war  this  research  group  had  developed  a  variety  of 
techniques,  relatively  easily  applied,  by  which  it  was  possible  to  control 
the  size  and  shape  of  ahell  and  bomb  fragments  to  a  remarkable  degree. 
These  techniques  were  never  used**  but  they  were  available  to  put  into 
operation  should  any  new  target  have  had  to  be  faced,  e.g,  a  tough  one 
against  which  only  large  fragments  could  be  effective, 

*  It  was  realised  later  that  some  of  this  effect  was  due  to  secondary 
break-up  of  the  large  fragments  on  striking  the  collecting  medium, 

**  It  was  found  later  that  the  Germans  had  applied  a  system  ojtf  external 
grooving  to  some  of  their  A.  A.  shell,  apparently  to  increase  t)he  frag¬ 
ment  size. 
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These  are  some  of  the  still  relevant  points  which  1  have  noted  in  again 
coming  into  contact  with  problems  of  weapon  research  and  development 
after  a  gap  of  several  years.  I  am  sure  there  are  other  lessens  to  be 
drawn  from  these  World  War  II  investigations,  and,,  without  doubt  those 
scientists  who  have  carried  on  continuously  in  government  service  will 
have  quietly  absorbed  them,  so  that  they  form  part  of  their  whole  attitude 
ox  approach  to  the  problems  of  today. 

THE  POSITION  TODAY.  There  are,  of  course,  many  obviouo  differ- 
ences  between: 

(a)  The  war-time  problem,  which  was  essentially  that  of  trying  to 
establish  an, understanding  of  a  weapon  system  in  service,  in  order  to 
determine  how  its  effectiveness  could  be  Improved,  under  conditions 
which  were  not  expected  to  change  radically  fribm  those  known  to  exist; 
and 

(b)  The  problem  of  today,  which  is  greatly  concerned  with  predictive 
assessments  of  the  operational  performance  of  future  systems,  taking  many 
years  to  develop  and  to  be  used  against  an  opponent  whose  future  equip¬ 
ment,  weapons  and  tactics  must  be  to  a  large  extent  a  matter  of  guesswork. 

In  the  course  of  war,  even  when  action  has  to  be  taken  to  meet  a  new 
situation,  this  can  be  done  by  working  on  the  basis  of  information  which 
possesses  some  element  of  reality.  A  good  example  of  this  occurred  in 
I944  with  the  launching  of  the  V.l  flying  bombB  against  London,  Within  a 
few  days  a  complete  bomb  which  had  been  shot  down  without  explodiiig  was 
recovered,  and  immediate  steps  could  be  taken  to  estimate  its  vulnerability 
to  shell^fire  and  fighter  attack. 

As  far  aB  1  can  recall,  priority  trials  were  undertaken  to  determine  (a) 
the  burst  pattern  of  a  proximity  fuze  around  such  a  target,  and 
(b)  the  nature  and  extent  of  its  vulnerability  to  A.  A.  shell  fragments.  How 
quickly  we  went  as  far  as  inserting  these  new  parameters  into  our  probability 
model,  I  cannot  remember:  but  it  must  have  been  soon  evident  that  the  V.l 

j  u-  j  i 'i  n  i  i  - ..  a.  :  _  i  _  <*, 
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guns  with  existing  shell,  provided  they  were  supplied  with  proximity  |uzes. 

The  large-scale  delivery  of  American  fuzes  and  the  appropriate  re -deployment 
of  guns,  when  achieved  after  some  weeks  when  the  fighter  aircraft  hitd  been 
forced  to  take  the  leading  defence  roll,  played  a  very  large  part  in  chuntering 
the  menace. 
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The  scientific  effort,  when  it  became  accepted  as  of  value  by  the  armed 
services,  was  quite  naturally  first  directed  to  the  study  of  the  performance 
of  individual  weapons  or  pieces  of  equipment;  the  radar  set,  the  proximity 
fuze,  the  terminal  ballistics  of  a  shell  or  (of  a  variety  of  anti-tank  weapons. 
Today  there  is  a  special  demand  for  scientific  aid  in  the  intractable  job  of 
peering  into  the  future,  The  lead  for  thiej  activity  was- of  course  provided 
by  the  Operational  Research  Sections  whij:h  were  closely  associated  with 
various  operational  commands  during  the1,  war.  In  this  very,  difficult  field 
of  prediction  in  which  the  last  war's  operational  experience  becomes  less 
and  less  relevant,  the  scientific  line  of  attack  must  consist  in  welding  to¬ 
gether  a  great  number  of  elements. 


The  following  scheme  of  relationships  illustrates  what  I  mean  by  the 
many-sided  approach:  , 


Mathematical  models 
Paper  study 


War  games 
Computer  games 


{ 

{ 


Laboratory  experiments 
Simulator  trials 
Range  trials 

i 

Field  experiments 
Army  exercises 


The  overall  inferences  to  be  drawn  from  the  whole  build-up  are  not  of  course 
matters  of  statistics;  but  the  use  of  the  theory  of  probability  and  of  stochastic 
processes  is  implicit  in  the  studies  on  the  left-hand  column,  while  statistical 
planning  plays  its  part  in  the  laboratory  experiments  and  the  range  trials-- 
cven  to  some  extend  in  the  field  trials. 


I  have  already  tried  to  illustrate  the  great  value  of  a  mathematical  model 
in  forming  the  structure  against  which  an  evaluation  problem  may  be  broken 
up  into  parts  for  separate  study,  In  so  doing  attention  is  drawn  to  the  linkjs 
in  the  construction  where  essential  information  in  quantitative  form  is  most 
needed  and  perhaps  most  lacking.  Again,  and  this  is  important,  by  permitting 
a  good  deal  of  elasticity  in  the  mechanism  and  allowing  for  the  introduction 
of  factors  which  might  conceivably  operate  in  a  future  situation,  the  model 

- 1-  ..  i.  - *44  +  4 -- -  < 
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teBted  during  field  trials  or  even  accepted  as  likely  under  present  combat 

conditions,  ! 

...  ,  i 

The  application  of  the  model  approach  to  the  problem  of  ground-to-air  "  ; 

missile  evaluation  is  the  natural  successor  to  the  war-time  investigations 
which  I  have  described.  The  break-up  of  the  problem  for  study  under  four 
headings  still  remains  as  before. 
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(a)  Engagement  geometry, 
(c)  warhead  effectiveness, 


(b)  fuze  performance,, 
(d)  target  vulnerability. 


But  problem  (a)  has  taken  a  much  more  complex  shape,  involving  perhaps 
the  use  of  both  analogue  and  digital  computers.  The  war  gaiide  has  an 
essential  part  to  play  as  a  research  tool  in  the  combined  attaijck  on  the 
problem  of  developing  weapons,  equipment  and  tactics  for  tlfo [  future.  Its 
main  function  is  perhaps  to  aid  thought  and  analysis  rather  than  to  obtain 
directo  results.  By  injecting  the  human  decision  process  into  the  study, 
it  provides  an  insight  into  the  complex  nature  of  land  battle  which  it  would 
be  hard  to  get  in  any  other  way.  In  thin  form  of  study,  as  elsewhere,  the 
essential  need  to  formulate  rules,  focuses  attention  on  the  limiting  condi¬ 
tions  which  have  to  be  accepted  by  whatever  route  we  try  to  make  predictions 
of  the  performance  of  future  systems, 

As  a  final  illustration  of  where  we  now  stand,  let  me  refer  to  a  problem 
of  considerable  present  interest  in  whose  solution  a  number  of  the  techni¬ 
ques  tabled  above  might  be  called  in.  This  is  the  problem  of  comparing 
the  merits  of  the  free  flight  gun  and  the  guided  missile  in  the  ground  attack 
on  armourii  Both  types  of  weapon  depend,  though  in  very  different  degree, 
on  the  human  operator: 

The  free  flight  gun.  Here  we1  have  a  system,  fairly  well  understood 
which  has  been  studied  for  years  and  for  which  a  reasonable  idea  of  per¬ 
formance  under  operational  conditions  is  available,  The  operator  has  only 
to  concentrate  while  laying  the  gun  and,  after  firing,  plays  no  further  part 
in  the  fate  of  that  particular  found.  The  greatest  element  of  uncertainty 
lies  in  the  vulnerability  of  his  Own  gun,  and  to  assess  this  requires  rather 
extensive  study  of  visibility  and  audibility  in  a  variety  of  environments. 

The  guided  weapon..  The  advantage  of  this  weapon  is  t.hat  its  firing 
position  can  be  concealed  behind  the  crest  of  a  hill.  However,  the  human 
controller  who  must  see  the  target,  has  to  concentrate  for  a  considerable 
time  (depending  on  the  range)  in  guiding  the  weapon  onto  the  target,  That 
he  can  do  this  with  fair  success  has  been  demonstrated  on  a  simulator  and 
with  live  weapons  used  under  trial  conditions.  The  open  question  here  is 
whether  he  can  maintain  this  performance  in  an  operational  setting,  when 
subject  to  the  fears  and  emotions  to  which  he  would  be  exposed  in  battle. 


A  sound  basis  for  any  policy  decision  on  these  alternative 
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without  these  missing  pieces  of  information- -the  vulnerability  of  the  gun  to 
enemy  counter  action,  the  fall-off  in  human  performance  in  a  battle  setting, 
and  now  adding  to  the  puzzle,  the  observational  power  C )£  the  helicopter, 
Success  in  solution  depends  not  only  in  not  overlooking  these  considerations 
but,  in  persuading  authority  to  provide  the  means  of  proceeding  to  the  answers 
How  often  one  wonders  have  important  decisions  on  weapon  policy  had  to  be 
taken  in  the  past  when  the  basic  information  for  a  real  comparison  was  not 
available,  although  with  greater  foresight,  perhaps,  it  might  have  been 
obtained  in  time. 

Finally,  it  may  again  be  asked;  what  of  the  statistician?  Have  I  pushed 
him  out  of  the  picture;  I  think  not.  You  must  remember  that  I  have  been 
concentrating  on  a  particular  aspect  of  this  matter  of  research,  development 
and  testing--the  assessment  of  operational  performance  of  weapons.  In 
this  peculairly  difficult  field,  the  statistician  becomes  the  scientist  who  must 
merge  hie  statistical  identity  into  that  of  a  group  of  men  trained  in  several 
disciplines,  but  prepared  to  give  no  undue  weight  to  any  one  of  them  in 
searching  for  answers  to  the  problems  in  hand.  That  at  any  rate  has  been 
my  personal  experience. 


APPLICATION  Of  28'*  FRACTIONAL  FACTORIALS  IN  SCREENING 
OF  VARIABLES  AFFECTING  THE  PERFORMANCE  OF  DRY  PROCESS 
ZINC  BATTERY  ELECTRODES 

Nicholas  T.  Wilburn 

U,  S,  Army  Electronics  Research  and  Develdpjment  Laboratory 
Fort  Monmouth,  New  Jersey 

Among  its  research  and  development  activities  on  ainc-siiver  oxide 
batteries  lor  special  applications,  USAELRDL  is  investigating  the  prep¬ 
aration  of  sine  electrodes  by  dry  processes.  These  involve  the  appli¬ 
cation  of  dendritic  sine  powders  under  pressure  to  the  grids.  The  inter¬ 
looking  properties  of  the  dendritic  sine  particles  make  it  possible  to  form 
the  electrodes  with  moderate  pressures  such  that  the  porosity  and  re¬ 
lated  high  surface  area  of  the  electrode  is  not  destroyed.  It  is  expected 
that  dry  process  sine  electrodes  will  have  many  advantage#  over  conven¬ 
tional  electrodeposttfld  sponge  sine  electrodes,  Including  higher  discharge 
efficiency,  greater  uniformity  of  performance  and  better  adaptability  to 
mechanised  production  with  resultant  economics. 

Due  to  the  large  number  of  variables  affecting  the  discharge  perform¬ 
ance  of  the  electrodes,  it  was  decided  to  ddsign  and  conduct  a  fractional 
factorial  experiment  to  isolate  the  significant  variables.  These  variables, 
and  any  controlling  interactions  betwesn  them,  could  then  be  studied  fur¬ 
ther  to  arrive  at  the  optimum  conditions  for  the  production  of  electrodes 
of  maximum  discharge  efficiency,  The  fractional  factorial  experiment, 
was  thus  intended  for  the  preliminary  screening  oif  all  major  variables 
acting  simultaneously,  As  such,  it  was  recognised  that  it  is  the  most 
efficient  and  economical  process  known  for  accomplishing  this,  In  addit¬ 
ion  to  providing  valuable  data  on  interactions  between  the  variables 
which  cannot  be  obtained  from  the  more  widely  used  one  or  two  at  a  time 
variable  investigations. 

There  were  two  categories  of  variables  in  the  electrode  investigation, 
those  related  to  the  electrolytic  formation  of  the  dendritic  sine  powders 
and  those  related  to  the  electrode  preparation  itself.  Although  several 
more  variables  were  considered,  it  was  decided  to  limit  the  number  of 

Variables  to  eight,  keeping  all  other  Mciuri  uunauuii,  Tub  aigiti  >ai«ui<iu 

variables  are  shown  in  Figure  1,  High  and  low  levels  as  shown  were 
assigned  to  each  variable.  Although  considerable  thought  wa?  given  to 
determination  of  the  levels,  it  is  seen  in  retrospect  thet  wider  ranges 
might  have  been  assigned  in  some  instances.  Based  on  available  literature, 
these  were,  however,  considered  sufficiently  wide  ranges. 

v _  ..  ." 

£  igurea  can  oe  found  at  the  end  of  inis  article  > 
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Variable  G,  the  electrolyte  temperature  during  the  plating  operation, 
turned  out  to  be  impossible  to  control  with  the  plating  equipment  wh|ch 
was  prepared  for  the  experiment  and  with  the  selected  plating  current 
densities.  The  experiment  thus  became  one  involving  seven  variables, 
each  at  two  levels.  Rather  than  to  eliminate  G,  however,  it  was  felt 
that  this  paper  would  serve  a  broader  purpose  if  it  gave  the  fractional 
factorial  procedures  for  the  study  of  eight  as  well  as  seven  variables. 
Variable  G  should,  therefore,  be  considered  both  in  and  out  of  the 
figures  and  analysis. 


Hiving  established  the  variables  and  the  high  and  low  levels,  the 
fractional  replicate  design  was  established,  as  shown  in  Figure  2.  This 
is  the  first  design,  a  Becond  having  been  run  later  for  reasons  to  be  dis¬ 
cussed.  The  design  involves  eight  variables  (or  seven)  each  at  two  level* 
to  be  studied  with  a  total  of  sixteen  different  electrodes,  A  full  2®  fac¬ 
torial  experiment,  eight  variables  each  at  two  levels,  would  involve  2® 
or  256  trials  (128  trials  for  a  2  7  factorial).  Therefore,  this  design 
represents  a  one  sixteenth  fraction  of  the  28  factorial  (one  eighth  of  the 
27),  expressed  as  &  desigp  (or  27-3  for  seven  factors).  The  de¬ 

sign  is  based  on  extension  of  a  basic  2^  or  16  trials.  Thus  the  first 
four  variables  are  arranged  in  standard  order  for  the  24  factorial.  The 
other  variables  are  then  intro  due  ed  by  making  a  basic  assumption  that 
three  factor  interactions  between  the  first  four  variables  are  negligible. 
Therefore  E  is  introduced  by  equating  it  to  the  interaction  between 
variables  A,  B,  and  G.  Regarding  the  high  level  as  plus  and  the  low 
level  as  minus,  the  level  of  E  for  the  first  box  is  -  x  -  ;'c  -  =  -  , 


+  x  -  x  -  ■  +  for  the  second  box,  etc.  Similarly,  variable  F  is  intro¬ 
duced  to  equating  it  to  the  BCD  interaction,  variable  G  to  the  ABD 
interaction  and  variable  H  to  the  A  CD  Interaction.  Normally  in  s>.  seven 
variable  design,  the  seventh  variable  would  be  equated  to  ABD  instead  of 
ACD  as  was  done  here  since  variable  G  was  dropped  out.  However, 
this  does  not  affect  the  27"3  experiment  in  any  way. 


Having  thus  established  the  fractional  design,  the  sixteen  electrodes 


were  prepared  in  accordance  will,  the  high  and  low  level  criteria  for  each 
variable.  The  electrodes  were  then  tested  one  at  a  time  under  standard 


and  carefully  controlled  conditions  to  give  the  sixteen  yields  or  responses 
as  shown.  The  response  is  the  discharge  efficiency  of  the  electrode  ex¬ 
pressed  in  percent  as  the  ratio  of  the  output  capacity  (at  a  discharge 
current  density  of  1.  1  amp/  Bquare  inch  to  a  0.  3  volt  change  for  the  elec¬ 
trode)  to  the  theoretical  capacity  of  the  zinc  active  material.  For  com¬ 
parison  the  conventional  sponge  zinc  electrodes  give  an  average  efficiency 
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of  about  20%  under  comparable  discharge  conditions.  The  average  of  the 
sixteen  responses  is  31,  2%,  Before  proceeding  with  the  analysis  of  the 
responses,  it  should  be  noted  how  the  design  can  be  used  to  relate  the 
sixteen  mean  effects  obtained  from  the  response  analysis  to  the  variables 
and  their  two  factor  interactions.  Consider  the  high  level  boxes  in  the 
first  four  columns,  The  first  moan  effect,  no  high  levels,  will  be  for 
twice  the  average.  The  second  will  be  for  variable  A,  the  third  for  B  , 
the  fourth  for  the  AB  interaction,  the  fifth  for  C  and  so  on.  The  eighth 
(A,  B  and  C  at  the  high  level)  will  be  for  variable  E  which  was  origin¬ 
ally  eclated  to  ABC.  Similarly  the  twelfth  for  G,  the  fourteenth  for  H 
and  the  fifteenth  for  F.  Since  this  is  a  one  sixteenth  fraction,  each  of 
these  principal  effects  will  be  confused  with  fifteen  other  effects.  How¬ 
ever,  these  for  each  of  the  eight  variables  will  be  three  factor  or  higher 
order  Interactions  which  are  con aidered  negligible ,  the  basis  on  which 
the  design  was  established.  Each  two  factor  interaction,  AB  for  example, 
will  be  confused  with  fifteen  other  effects  of  which  three  are  other  two 
factor  interactions.  The  sixteenth  row  of  the  First  Design  will  represent 
such  a  combination  of  four  2  factor  interactions^ 

.'.I  . 


The  analysis  of  the  sixteen  responses  is  shown  in  Figure  3,  The 
technique  used  here  is  the  Yates'  Algorithm  which  is  a  rapid  method  for 
obtaining  the  same  mean  effects  that  would  be  obtained  from  a  formal 
and  lengthy  analysis  of  variance.  The  Yates'  Algorithm  is  applicable 
to  any  factorial  experiment.  Us  advantages  become  more  apparent  the 
larger  the  experiment. 


The  mechanics  of  the  Yates'  calculations  are  very  simple.  The  first 
figure  in  Column  (1)  is  the  sum  of  responses  1  and  2;  the  second,  the 
sum  of  responses  3  and  4,  etc.  The  ninth  figure  is  the  sum  of  responses 
1  and  2  with  the  sign  of  response  1  reversed.  Column  (2)  is  derived  from 
Column  (1)  in  the  same  manner.  Additional  columns  are  introduced  until 
a  column  is  completed  the  first  figure  of  which  is  equal  to  the  sum  of  the 
responses.  The  arithmetic  in  each  column  is  checked  before  proceeding 
to  the  next  column,  The  sum  of  Column  (1)  is  equal  to  twice  the  sum  of 
the  even  numbered  responses;  the  sum  of  Column  (2)  is  equal  to  four 
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Column  (3)  is  equal  to  eight  times  the  sum  of  every  fourth  even  numbered 
response;  and  the  sum  of  Column  (4)  is  equal  to  sixteen  times  the  sixteenth 


response.  The  mean  effects  are  obtained  by  dividing  each  figure  of  Column 
(4)  by  eight.  The  sum  of  the  mean  effects  is  also  checked.  The  62.  363 
figure,  twice  the  average,  is  not  used  in  the  subsequent  analysis.  The 
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effects  measured  by  the  mean  effects  are  given  in  the  last  column.  The 
effects  A,  B,  AB,  C,  AC,  etc.  ate  those  as  previously  read  off  the, first 
desigi|  chart.  The  three  factor  and  higher  order  interactions  which  they  are 
confuted  with  are  of  no  importance  since  the  design  is  based  on  their  . 
being  assumed  negligible.  The  other  two  factor  interactions  are  impor¬ 
tant  and  must  be  known.  They  are  obtained  from  the  effects  A*  B,  AB, 
etc.  and  the  defining  contrasts  of  the  design.  These  defining  contrasts 
are  obtained  from  the  equaling  that  had  been  done  in  establishing  the 
fractional  design;  E  *  ABC,  F=  BCD,  Q  =  ABD  andH  »  ACD.  Sixteen 
defining  contrasts  are  required  for  the  eight  variable  design,  The  first 
defining. contrast  is  always  1,  the  next  four  are  ABCjkj,  BCDF,  ABDG 
and  ACDH,  The  remaining  eleven  are  found  by  exhaustively  multiplying 
these  contrasts  using  the  rule  that  like  factors  are  cancelled  out, 

(1)  I 

(2)  ABC  x  E  »  A  BCE 

(3)  BCD  x  F  ■  BCDF 

(4)  ABD  x  Q  •  ABDG.. 

(5)  ACD  xH  *  ACDH 

(6)  A$(CE  x  D0DF  e  ADEF 

(7)  ADCE  xA  DDG  «  CDEG 

(8)  4BQE  x4$DH  »  BDEM 

(9)  DCDF  x  ADDG  »  ACFG 

(10)  BDDF  x  ACDH  *  ABFH 

(11)  4bDG  x  ACDH  *  BCGH 

(12)  ADCE  x  DCDF  x  ABDG  *  BEFG 

(13)  ADCE  x  DCDF  x  ACDH  =  CEFH 

(14)  ADCE  x  ADDG  X  ADDH  =  AEGH 

(15)  DCDF  xADDG  xACDH  *  DFGH 

(16)  AD<?E  x  DDDF  X'ABDO  X  ACDH  *  ABCDEFOH  , 

(These  sixteen  defining  contrasts  may  also  be  obtained.by  simply 
reading  off  the  low  level  boxes  for  each  of  the  sixteen  trials  in  the  First 
Design  chart.  However  this  procedure  will  not  apply  in.  all  cases,  e.  g. 
in  the  Z1"*  it  would  give  sixteen  defining  contrasts  when  only  eight  are 
required.) 

The  principal  effects  are  found  by  multiplying  the  first  effect,  A,  B, 

AB,  etc.,  by  the  sixteen  defining  contrasts.  The  two  factor  interactions 
confused  with  AB  are  found  for  example  to  be  CE,  DG  and  FH. 
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AB  x  l  s AB 
JttxATt CE  ~CE 
l)f|l  xljtUDG  =  DG 
At  xjjf^FH  =  FH 


The  other  twelve  effects  confused  with  AB,  all  three  factor  oi 
higher  order  interactions,  could  be  found  with  the  other  twelve  defining 
contrasts  if  desired.  The  total  256  effects  found  by  multiplying  each 
starting  effect  by  the  sixteen  defining  contrasts  would  give  die  full  256 
effects,  from  I  to  the  interaction  A BGDEFGH,  which  would  be  obtained 
in  conducting  a  full  2  factorial  experiment. 

7-3 

The  defining  contrasts  for  the  2  experiment  are  I,  ABGE, 

BCDF,  AC  DM,  AEDF,  BDEH,  ABFH,  and  CE.FH,  The  effects  measured 
are  found  in  the  same  way  as  for  the  eight  variable  design.  Tho  only 
difference  is  that,  in  this  case,  all  effects  Involving  G  drop  out.  The 
twelfth  set  of  effects  measured,  identified  by  the  asterisk,  then  becomes 
eight  interactions,  ail  three  factor  or  higher  order., 

The  fifteen  moan  effects  with  their  identifying  effects  are  then  ordered 
by  arranging  them  in  order  of  magnitude  without  regard  to  sign.  The 
thus  ordered  set  of  mean  effects  is  then  arranged  in  a  half-normal  plot 
as  shewn  in  Figure  4  to  interpret  the  relative  significance  of  the  effects. 
THe  ordinate  is  the  order  number  of  thB  fifteen  effects  from  smallest  to 
largest.  The  abscissa  gives  the  moan  effect  magnitudes.  The  fifteen 
points  which  are  plotted  are  identified  by  the  proper  major  effects  and 
two  factor  interactions.  The  plot  is  given  for  both  the  full  eight  variables, 
and  the  actual  seven  variable  experiment.  In  tho  latter  case,  the  G 
factor  and  the  G  interactions  drop  out.  The  asterisk  again  denotes  high 
order  interactions.  In  the  plot  an  error  best  straight  line  has  been  drawn 
through  the  lowest  Seven  pointa.  High  magnitude  effects  falling  signifi¬ 
cantly  off  the  line  are  judged  to  be  distinct  from  error  and  therefore  con¬ 
trolling  factors  in  the  process  being  investigated.  In  a  plot  of  thiB  type, 
it  is  considered  unusual,  however,  to  have  a  well  defined  error  line  , 

with  a.S  nmnv  act  eight  points  falling  rlssrly  nff  it.  TO  g“i*i  insight  into 

this  unusual  behavior  as  well  as  to  gain  more  precision  in  the  estimation 
of  all  of  the  effects,  it  was  decided  to  conduct  a  second  phase  of  the  experi¬ 
ment,  another  group  of  sixteen  electrodes  differing  from  the  first.  Since 
an  interaction  between  A  (the  highest  magnitude  effect)  and  B  appeared 
reasonable,  and  since  F  and  H  were  both  high  magnitude  effects  which 
might  interact  with  each  other,  it  was  decided  to  establish  the  Becond 
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design  in  such  a  way  as  to  separate  the  AB  and  FH  interactions. 
Although  this  can  be  done  in  several  equally  effective  ways,  it  was  de- 
cided  to  do  it  by  reversing  the  levels  for  factors  A  and  D,  giving  the 
design  as  shown  in  Figure  5, 

This  design  is  identical  to  the  first  except,  for  the  reversal  of  levels 
of  variables  A  and  D,  Sixteen  electrodes  were  prepared  in  accordance 
with  the  indicated  variable  levels.  The  electrodes  were  then  tested  to 
give  the  listed  responses.  The  next  step  in  jthe  experiment  was  to  deter¬ 
mine  the  mean  effects  generated  by  these  responses  and  to  combine  them 
with  the  mean  effects  resulting  from  the  first  design.  This  may  be  done 
in  two  ways.  The  first  is  to  combine  the  two  sets  of  sixteen  responses 
into  an  overall  group  of  thirty-two  and  then  to  conduct  a  Yates'  computat¬ 
ion  to  arrive  at  the  thirty-two  mean  effects.  The  second  way  Id  to  conduct 
a  Yates'  computation  on  the  second  design  responses  and  then  combine 
the  mean  effects  with  those  of  the  first  design.  The  firbt  method  is  less 
time  consuming  and  therefore  preferable.  The  second  method  gives  a 
clearer  picture  of  the  separation  of  effects  and  is  therefore  now  given, 

{The  first  method  is  given  in  Appendix  A -1) 

Figure  6  shows  the  Yates'  computations  on  the  responses  from  the 
second  design.  The  operations  are  identical  to  those  as  described  for 
the  first  design.  It  is  noted  that  the  signs  of  ail  elements  involving  A 
and  D  in  the  Effects  Measured  column  are  now  minus  since  the  levels 
of  A  and  D  had  been  reversed.  This  reversal  of  signs  permits  the 
separation  of  effects  as  shown  in  Figure  7. 

The  mean  effects  derived  from  the  first  design  are  given  in  the  column 
marked  X,  Those  derived  from  the  second  design  are  given  in  ths  column 
marked  Y.  An  example  of  the  computation  to  separate  the  effects  is  as 
follows: 


The  second  mean  effect  in  the  X  column  is  for  variable  A.  The 
similar  mean  effect  in  the  Y  column  is  for  minus  variable  A  with  the 
difference  in  the  absolute  magnitudes  of  the  mean  effects  being  due  to 
experimental  error,  Reversing  the  sign  of  the  column  Y  mean  effect 
and  averaging  Lt  with  that  of  the  column  X  mean  effect  will  give  the 
-4,  SI  mean  effect  for  variable  A  and  certain  high  order  interaction# 
confused  with  it.  1/2(X+Y),  -1.  36,  then  gives  the  mean  effect  for  the 
remaining  high  order  interactions  originally  confused  with  A.  Similar 
calculations  are  performed  to  separate  all  of  the  other  effects,  those 
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Design  of  Experiments  ^3 

thus  obtained,  not  including  the  6l.  22  (twice  the  average)  figure,  are 
then  arranged,  in  order  of  magnitude  without  respect  to  sign  and  plotted 
in  a  thirty-one  factor  half-normal  plot  as  shown  in  Figure  8. 


It  is  seen  that  the  error  best  straight  line  is  now  established  by 
twenty-three  of  the  thirty-one  points  reflecting  the  greater  precision 
achieved  by  doubling  the  experiment  and  thereby  reducing  the  variance 
of  the  estimated  effects  by  one -half.  Of  the  eight  points  which  are 
clearly  off  the  line,  two  of  them,  denoted  by  asterisks, are  combinations 
of  high  order  interactions.  Their  relative  significance  cannot  be  inter¬ 
preted  within  the  limits  of  the  experiment.  As  will  be  seen,  equating 
them  to  zero  wijl  not  affect  the  results.  The  BF  interaction  is  not 
far  off  the  line  and  its  significance  may  be  questioned.  Variables  E 
and  A  are  both  clearly  controlling  factors  in  the  efficiency  of  the  zinc 
electrodes.  The  signs  of  their  mean  effects  are  both  minus,  indicating 
that  higher  efficiencies  can  be  obtained  at  the  lower  levels  of  the  ranges 
studied,  in  other  words  at  the  lower  pressing  temperature,  80°  F, 
and  with  the  smaller  weight  of  zinc  per  plate.  The  interpretation  of 
variable*  H,  the  formation  current  density,  and  F,  the  presence  or 
absence rof  zinc  oxide  in  the  formation  electrolyte,  is  more  complex. 
This  results  from  the  probable  significance  of  FH,  the  interaction  be- 
\  "tween  them  (CE  is  very  unlikely  to  be  significant  due  to  the  low  magni¬ 
tude  of  C).  In  general  when  an  interaction  is  large,  as  in  this  case,  the 
corresponding  mean  effects  cease  to  have  much  meaning.  The  effect  of 
F  is  clearly  dependent  upon  the  level  of  H  and  vice  versa.  The  three 
effects  F,  H  and  their  interaction  FH  may  best  be  interpreted  as  a 
single  highly  significant  effect.  Further  experimental  work  at  inter¬ 
mediate  levels  for  the  two  variables  is  definitely  indicated. 


Yhe  final  step  in  the  analysis  was  to  determine  if  the  conclusion  was 
correct  that  only  the  effects  E,  A  and  the  combined  effects  of  H,  F  and 
FH  were  significant,  i.  e.  ,  distinct  from' experimental  error.  Fart  of 
the  purpose  of  this  final  step  was  to  determine  if  the  entire  experiment 
was  valid,  in  other  wordB,  that  there  were  no  large  errors  made  in  the 
actual  responses  which  could  have  seriously  altered  the  mean  effects. 
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ual  observed  responses  by  analyzing  the  thirty-one  mean  effects,  A 
second  standard  error,  for  the  differences  between  observed  and  pre¬ 
dicted  responses,  was  then  obtained  with  the  predicted  responses  based 
on  the  assumption  that  all  mean  effects  other  than  those  for  E,  A,  H, 

FH  and  F  were  indeed  zero.  If  the  two  standard  errors  would  then  be 
equivalent,  both  the  total  experiment  and  the  conclusions  derived  from 
it  would  bs  pro  vs  d,  valid. 


?  3r‘P'l 


24 


Design  of  Experiments 

Since  the  error  straight  line  on  the  final  half-normal  plot  was  es¬ 
tablished  by  the  twenty -three  jowest  magnitude  points,  a  half -normal  plot  * 
for  these  point's  was  prepared,  The  standard  error  for  the  individual 
observed  responses  as  derived  from  this  plot  was  3,  0.  (See  A -5),  All 
mean  effects  other  than  the  twice  the  average  effect,  E,  A,  H,  FH  and  F 
were  then  equated  to  zero  and  a  reverse  Yates'  computation  was  con¬ 
ducted  to  obtain  the  thirty-two  predicated  responses  (See  A-2).  These 
responses  were  compared  with  the  observed  responses  ahd  a  list  of  the 
thirty-two  differences  between  the,  observed  and  predicted  responses  was 
prepared  (See  A -3).  The  magnitudes  of  the  differenced  were  plotted  on 
normal  probability  paper.  A  standard  error  was  obtained  from  this  ;i 
plot  for  the  difference  between  individual  observed  responses  and  individ¬ 
ual  predicted  responses.  The  value  of  this  standard  error  was  3.  2  (See 
A -4),  This  was  in  excellent  agreement  with  the  Standard  error  of  the 
individual  observed  responses,  thus  proving  the  validity  of  the  experiment 
and  the  conclusions  derived  from  it, 

In  conclusion,  a  fractional  factorial  designed  experiment,  involving 
two  27*3  fractional  designs,  has  been  conducted  to  determine  the  signi¬ 
ficance  of  seven  major  variables,  and  two  factor  interactions  between  them, 
on  the  discharge  efficiency  of  the  dry  process  zinc  battery  electrodes, 

A  total  of  thirty-two  electrodes  was  prepared  and  tested,  Analysis  of 
their  responses  has  indicated  the  controlling  influence  of  two  of  the  vari¬ 
ables,  pressing  temperature  and  the  amount  of  zinc  per  plate,  and  of  the 
interaction  between  two  other  yariables  relating  to  the  plating  conditions 
under  which  the  zinc  material  was  prepared.  The  other  three  variables 
have  been  shown  to  be  unimportant  in  comparison,  within1  the  range  of 
levels  selected.  The  experiment  has  fulfilled  its  basic  purpose, /  narrowing 
down  the  range  of  variables  to  permit  extensive  investigation  of  the  truly 
important  variables  in  order  to  arrive  at  the  optimum  electrode  prepara¬ 
tion  procedures  in  the  most  expeditious  manner, 
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fj  APPENDIX 

..  !i; 

■'This  appendix  contains  supplemental  data  as  follows: 

"if  V 

A -1.  Yates'1  Algorithm  computation  for  thirty-ttoo  responses,  combin¬ 
ation  of  Designs  1  aitjd  2. 

A-2.  /Reverse  Yates'  Algorithm  computation  for  thirty-two  effects,  assum¬ 
ing  all  effects  are  zero  except  those  for  average,  E,  A,  H,  FH  and  F. 

A -3,  Comparison  of  observed  and  predicted  responses, 

A-4.  Probability  ploi  to  obtain  standard  error  of  individual  differences 
between  observed  %nd  predicted  response^. 

A-5.  Half-normal  plot  of  twenty-three  mean  effects  to  obtain  standard 
error  of  individual  observed  responses. 
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A-l,  Yflt,«6'  Algorithm  eomputHfclon  for  lhlrty-tw.  risanumxia ,  romblnHion  of 
Dr  B:Jfr,mj  1  and  2, 
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A-3.  Comparison  of  observed  and  predicted  responses. 
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Applications  of  the  Calculus  of  Factorial  Arrangements 
I.  Block  and  Direct  Product  Designs 

Badrig  Kurkjian  and  Marvin  Zelen 
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and 

Mathematics  Research  Center,  TJ.  S.  Army,  University  of  Wisconsin 


ABSTRACT 


This  paper  deals  with  some  applications  of  a  general  theory  for  the 
analysis  of  factorial  experiments  as  reported  by  the  authors  in  the  June  1962 
issue  of  the  Annals  of  Mathematical  Statistics. 

General  expressions  are  given  for  the  usual  quantities  associated  with 
the  analysis  of  variance  for  the  cases  where  simple  treatments  or  factorial 
treatment-combinations  are  applied  to  Randomised  Blocks,  Balanced  Incom¬ 
plete  Blocks,  Group  Divisible  designs,  and  a  wide  class  of  Kronecker  Product 
designs. 

The  main  point  of  the  new  theory  is  that,  for  a  wide  class  of  the  more 
practical  designs,  the  complete  analysis  can  be  carried  out  almost  by 
inspection  of  the  normal  equations,  with  no  requirement  for  inverting  the 
normal  equations, 

Thti  complete  version  of  this  paper  is  published  in  BIOMETR1KA,  Vol,  50, 
Parts  1  and  2,  June  1963. 


STATISTICAL  DESIGN  OF  EXPERIMENTS  FOR  CONTINUOUS  DATA 


Paul  C.  Cox 

Reliability  and  Statistics  Office 
The  Army  Missile  Test  and  Evaluation  Directorate 
White  Sands  Missile  Range,  New  Mexico 

I.  INTRODUCTION.  I  wish  to  talk  on  the  subject  of  how  one  would 
design  an  experiment  and  analyse  the  data  when  the  results  come  i.h  the 
form  of  a  continuous  curve,  rather  than  just  a  single  value.  This  is  an 
area  that  would  appear  to  have  extensive  application  in  science  and 
engineering.  For  example;  velocity  data,  trajectory  data,  meterological 
data,  thrust  data,  etc.  As  I  just  mentioned,  1  am  interested  in  the  design 
of  experiments,  which  means  I  am  not  concerned  with  the  evaluation  of  a 
single  curve,  but  many  curves  obtained  as  a  result  of  testing  under  several 
sets  of  conditions,  and  very  likely  each  set  of  conditions  will  have  some 
replications. 

To  illustrate  what  1  have  in  mind,  I  will  uBe  rocket  motor  thrust  curves, 
although  I  could  have  used  some  other  type  of  curve  equally  effectively. 

Now  many  results  from  rocket  motor  tests  can  easily  be  analysed.  For 
example;  average  exhaust  velocity;  effective  (average)  pressure;  total 
impulse;  specific  impulse,  etc.  These  are  simple  to  analyze  because  the 
data  for  a  given  test  usually  comes  in  the  form  of  one  single  number. 
However,  if  we  want  to  estimate  a  typical  or  average  thrust  curve  when  a 
motor  is  tested  under  given  conditions,  this  is  quite  a  different  problem, 

To  keep  this  report  unclassified,  the  thrust  data  which  will  be  dis¬ 
cussed  will  be  completely  fictitious.  The  data  is  not,  to  my  knowledge, 
appropriate  for  any  existing  rocket  motor,  but  the  general  shape  of  the 
curve  is  similar  to  what  may  be  expected  for  a  number  of  motors  currently 
in  use. 

The  extensive  information  available  in  such  areaB  as;  Regression 
Analysis;  Random  Processes;  Power  Spectral  Analysis;  Time  Series; 
Analysis  of  Covariance;  Multivariate  Analysis;  and  similar  fields  may 
easily  cover  the  problem  I  am  going  to  present.  Therefore,  my  first 
question  is,  if  the  solution  is  readily  available  in  the  literature,  I  would  (1) 
like  some  references.  My  second  question  is,  if  it  is  not  readily  available 
but  you  know  the  answers,  1  will  appreciate  me  information.  (Piease  note  (2) 
that  there  are  numbers  along  the  margins  of  this  report.  These  numbers 
refer  to  specific  questions  which  may  be  found  at  the  end  of  this  report,  j 


I  will  conclude  the  introduction  by  stating  that  the  five  panel  members, 

W.  T.  Federei1,  B.  G.  Greenberg,  M.  A.  Schneiderman,  H.  L.  Lucas, 
and  H,  O.  Hartley  have  all  prepared  and  forwarded  their  comments,  These* 
are  included  at  the  end  of  the  report  in  the  order  in  which  they  wars  received. 
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II.  BASIC  ASSUMPTIONS. 


B.  The  Second  assumption  we  will  make  is  that  the  propellant  mix 
from  whence  the  motors  are  selected  as  well  as  the  preconditioning 
temperature  can  influence  the  shape  of  the  thrust  curve.  We  will  use  motors 
selected  from  the  three  propellant  mixes  (A,  B,  and  C),  and  conditioned 
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at  liiree  temperatures  (0°,  50°,  and  100°  F).  We  will  use  27  motors,  nine 
randomly  selected  from  each  mix,  and  of  the  nine,  three  conditioned  at  each 
of  the  temperatures,  This  arrangement  is  illustrated  in  Figure  2. 


Conditioning  Temperature 

Mix 

o° 

50° 

ioo° 

A 

3 

3 

3 

B 

3 

3 

3 

C 

3 

3 

3 

Figure  2 

Number  of  motors  selected  from  each  mix 
and  conditioned  at  each  temperature. 


G,  The  third  assumption  is  that  temperature  conditioning  will  have  an 
effect  similar  to  that  illustrated  in  Figure  3.  These  three  curves  actually 
represent  the  average  of  the  curves  selected  from  Mix  A  and  conditioned 
according  to  the  specified  temperature. 

D.  The  fourth  and  final  assumption  is  that  the  Test  Engineer  will  want 
the  following  information: 

1.  Does  Mix  difference  or  temperature  conditioning  have  a  significant 
effect  upon  the  shape  of  a  thrust  curve  7 

2.  For  a  given  propellant  mix  or  temperature  what  is  the  mean  or 
expected  thrust  curve? 

3.  Tn  aririiHnn  t*n  fhp  mpan  thrift  CUTV®,  COnfidsr.C"  tOlCTir.CC 

bounds  are  desired. 

III.  ANALYSIS  OF  VARIANCE. 

A.  If  you  refer  again  to  Figure  1,  you  will  observe  a  slightly  de¬ 
clining  plateau  between  points  C  and  D.  I  resolved,  first  of  all,  to  compare 
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performance  to  this  plateau  area.  One  problem  is  evident  from  Figure  2, 
namely  the  plateau  areas  are  of  different  length  at  different  temperatures. 

I  therefore  decided  tq'  study  only  the  region  from  15  to  42  seconds  inclusive 
For  all  27  rounds,  I  read  the  values  at  3  second  intervals,  that  is  to  say 
(15,  18,  .  ,  .  42  seconds).  The  variances  appeared  to  be  homogeneous  in 
the  region,  so  we  performed  the  analysis  of  variance  illustrated  in  Fig.  3. 


Source  of  Variance 

SS 

MS 

F 

Mix 

2 

43217.  71 

21 608, .89 

82.  72** 

Temperature 

2 

488387. 22 

244193.61  , 

9 34 .7 8*# 

Time 

9 

12325.  61 

1369. 50 

$b,  24** 

(Hylix)(  Temperature) 

4 

19794. 61 

4948. 65 

18.94** 

(Mix)(Time) 

18 

513.  70 

28.  52 

O.  11 

(Time)(Temperature) 

18 

2954. 70 

164. 15 

0.  63 

(Mix)(Time)(Tclmperature) 

36 

24459. 88 

679.44 

2.  60** 

Error 

180 

47022.04 

261.23 

o  (16.  16) 

Total 

269 

638674.97 

^Significant  at  .05  level  (Single  and  double  asterisk  used  in  later  tables 
^Significant  at  ,Oi  level  have  the  same  meaning  Indicated  here.  ) 


Figure  4 

Analysis  of  Variance  of  Thrust  Values  between  15  and  42  seconds 

for  27  motors 

From  Figure  4  it  appears  that  for  these  curves,  temperature  has  a 
highly  significant  effect,  mix  has  an  important  effect,  and  there  is  a 
significant,  downward  trend  during  this  time  interval.  While  the  mix- 
temperature  interaction  is  significant,  its  F  value  is  relatively  small;  so 
we  will  assume  it  is  not  really  critical.  It  may  also  be  observed  that  the 
pooled  estimate  of  variance  1b  261.23,  and  we  will  therefore  assume  a 
standard  error  of  16  lbs.  with  180  degrees  of  freedom.  1  then  proceeded 
to  construct  9  graphs,  one  for  each  combination  of  temperature  and  mix. 
Figure  5  illustrates  the  graph  for  Mix  B  and  50  temperature.  I  took  the 
sample  uf  three  and  plotted  the  iVieau  values  fur  the  interval  from  15  to  42 
seconds,  Next,  I  used  the  pooled  estimate  of  variance  and  plotted  95 /o 
confidence  bounds  on  this  curve,  and  then  on  the  outside  of  thia,  I  plotted 
tolerance  bounds,  y  =  95 /o,  P  =  90 /o. 
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Clearly,  the  question  at  this  point  is  that  of  the  propriety  of  arbitrarily 
taking  a  time  curve,  observing  the  values  at  stated  intervals  (every  three 
seconds  in  this  case)  and  considering  time,  along  with  mix  and  temperature, 
as  one  of  the  treatments  in  the  analysis  variance.  It  is  interesting  that  the 
error  term  has  180  degrees  of  freedom,  Had  we  arbitrarily  chosen  2 
second  intervals,  for  example,  instead  of  3  second  intervals  for  taking  our 
readme's  t.he  degrees  of  freedom  for  error  would  have  increased  to  270. 
There  is  clearly  something  illogical  at  this  point, 

B,  Referring  again  to  Figure  1,  you  will  note  that  I  have  arbitrarily 
selected  six  critical  points,  I  then  proceeded  by  performing  an  analysis  of 
variance  for  both  the  X  and  Y  component  for  each  of  these  critical  compon¬ 
ents.  The  Analysis  of  Variance  for  the  Y  component  of  A  is  given  in  Fig.  6 
and  the  X  component  in  Figure  7, 


Sources  of  Var 

S3 

wmm 

MS 

F 

Mix 

198 

n 

99 

O.  74 

Temp 

27  746 

H 

13, 873 

104.  30 

Interaction 

200 

■ I 

50 

O..  38 

Error  1 

■j 

2,  398 

18 

133 

Total 

30  ,  542 

26 

Figure  b  S 

Analysis  of  Variance  /or  the  Y  (Thrust  in  lbs)  Component  at  Point  A. 


Sources  of  Var 

SS 

d/f 

MS 

F 

Mix 

.  1267 

.0634 

1.  80 

Temp 

.  8339 

.4170 

11,  88** 

Int  s  ruction 

.  3  129 

A 

A  ■ 

\  tt  LA 
•  *  V  VI 

a  a  n 
■a  i  iw 

Error 

.  6317 

18 

.0351 

Totals 

1.9052 

26 

Figure  7 

Analysis  of  Variance  for  the  X  (Time  in  seconds)  Component  for  Point  A 
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From  this  it  may  be  observed  that  temperature  had  a  significant  effect 
but  mix  did  not.  Returning  to  Figure  5,  the  mean  value  was  located  for 
Point  A  and  a  confidence  rectangle  was  drawn  about  it.  This  procedure  was 
also  followed  for  the  other  five  critical  points  and  these  points  were  then 
connected,  For  the  time  component,  temperature  had  a  significant  effect 
for  all  six  critical  points,  mix  at  points  D,  E,  and  F.  For  the  thrust 
Component,  temperature  had  a  significant  effect  at  all  points  except  F  and 
mix  had  a  significant  effect  at  points  B,  D,  and  E. 

One  will  obviously  be  concerned  at  this  point  by  the  fact  that  the  six 
critical  points  were  arbitrarily  chosen  and  are  not  precisely  defined.  This 
could  easily  result  in  considerable  inaccuracy  in  collecting  data  for  these 
points.  However,  this  fact  will  not  necessarily  be  emphasized  since  it  is 
not  really  relevant  to  the  basic  purpose  of  this  paper. 

However,  the  matter  of  performing  separate  analysis  of  the  time  and 
thrust  components  of  each  critical  point  1b  highly  questionable,  and  I  am 
certain  that  a  procedure  applying  the  bivariate  normal  distribution  would 
be  in  order. 

Referring  either  to  Figures  1  or  5,  it  would  appear  reasonable  that  if 
an  analysis  of  variance  is  appropriate  for  C-D,  then  it  would  probably  be 
equally  appropriate  for  A-C  and  possibly  for  E-F.  In  fact,  it  would  appear 
more  sensible  than  attempting  to  locate  and  evaluate  critical  points. 

IV,  REGRESSION  ANALYSIS.  A  second  approach,  and  one  which  I  feel 
offers  more  promise  is  in  the  area  of  regression  analysis  and  polynomial 
fitting,  I  will  discuss  a  few  ideas  along  this  line  at  the  present  time. 

If  you  will  refer  to  Figure  1  again,  .1  arbitrarily  broke  the  graph  up  into 
four  distinct  segments,  These  are:  O-A;  A-C;  C-Dj  and  E-F,  Then,  for 
all  2?  motors,  I  fitted  the  most  appropriate  polynomial,  that  is  to  say,  I 
fitted  a  cubic  to  A-C  and  straight  lines  to  the  other  three  segments. 

I  will  discuss  the  procedures  I  followed  in  analyzing  segment  C-D  and 
state  little  more  than  that  analyses  were  performed  on  the  other  segments, 
ana  upon  completion  an  segments  wure  plotted  until  they  Intersected,  Using 
the  values  from  15  to  45  seconds  and  recording  the  data  at  3  second  inter¬ 
vals,  a  straight  line  was  fitted  for  all  27  sets  of  data  and  an  analysis  of 
variance  was  performed  for  a,  b,  and  r  in  the  equation  Y  =  a  +  b.  (X-30). 
Figure  S  gives  the  analysis  of  variance  and  mean  values  for  a,  while  Figure 
9  gives  the  analysis  of  variance  and  means  values  for  b,  (note  that  mix  had 
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no  significant  effect  upon  b,  so  the  mean  values  reflect  only  temperature).  (6) 
Neither  mix  nor  temperature  had  any  significant  effect  upon  r  (the  correlation 
coefficient),  but  the  mean  value  of  the  27  correlation  coefficients  was  82  /o. 


Sources  of  Variation 
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ioo° 

A 
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348 
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B 

292 
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385 

C 

264 

309 

376 

Ave 

278 

340 

379 

Figure  8 

The  Analysis  of  Variance  and  the  Mean  Values  for  a, 
when  Fitting  the  Equation,  Y  =  a  +  b  •  (X-30) 

15  sec  <L  x  <  45  sec  (all  means  computed  from  a  sample  of  3, 
y  =  thrust  In  lbs. ,  x  =  time  in  seconds). 
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Sources  of  Variation 
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Figure  9 


The  Analysis  of  Variance  and  Mean  Values  for  b, 
obtained  from  fitting  the  equation  Y  «  a  +  b<  (X-30), 

15  sec.  <xi45  sec.  (all  meani  computed  from  a  eample  of  9) 


The  data  in  Figure  9  indicate*  that  "b"  increases  almost  linearily  with 
temperature.  In  fact,  the  formula  b  =  -.410  -  (.00905)  temp,  might  serve 
as  a  guide  for  selecting  “b"  in  the  region  O  &  temp  <  1QO  .  If  one  desires 
a  formula  for  estimating  naB  in  the  region  for  O  <  tgmp  <  lOO  ,  he  might 
try  the  formula;  a  a  278  +1,4  •  (temp)  -  .  004l(temp)  which  averages  out 
the  rriix  effect. 

Again  referring  to  Figures  8  and  9,  one  may  observe  that  the  standard 
error  for  "an  is  18.7  lbs.  with  18  degrees  of  freedom,  and  the  standard 
error  for  Bbn  is  O.  545,  also  with  18  degrees  of  freedom. 

In  addition  to  this,  each  time  a  line  is  fitted  by  least  squares,  it  is 
possible  to  obtain  a  standard  error  of  estimates  and  standard  errors  for 
"a"  and  "b" .  For  the  27  curves,  I  pooled  these  standard  errors  and  obtain 

the  following  reHulta- 

Pooled  Standard  Errors  of  estimates; 

3.  40  lbs.  with  243  d/f.  1 

Pooled  Standard  Error  for  "to"; 

O.  324  with  243  d/f. 
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Pooled  Standard  Error  for  "a"; 

1.  025  with  243  d/f. 

As  may  be  expected,  the  estimates  for  the  standard  error  for  both  "a”  and 
"b"  are  larger  in  Figures  8  and  9  than  the  pooled  estimates  listed  above. 
This  is  reasonable  since  the  estimates  in  Figures  8  and  9  include  the  dis¬ 
persions  that  exist  among  curves  from  the  same  lot  and  conditioned  at  the 
same  temperature,  while  the  pooled  estimates  reflect  the  variation  within 
only  a  single  curve. 

Inasmuch  as  1  am  attempting  to  classify  any  curves  which  come  from  a 
given  mix  and  a  given  temperature,  it  would  seem  more  appropriate  to  use 
the  estimates  of  variability  in  Figures  8  and  9.  One  other  argument  for  this 
lies  in  the  fact  that  when  the  standard  error  of  estimates  was  computed  for 
each  of  the  27  curves,  it  was  computed  from  11  points,  selected  from  the 
thrust  curves  at  3  second  intervals.  15  sec  £  time  $,  45  sec.  Again  the 
question  arises  concerning  the  arbitrariness  in  choosing  3  second  intervals 
instead  of  soma  other  intervals. 

Now  confidence  bounds  for  a  regression  line  at  a  point  may  be 
computed  from  the  formula 

Yj  -  t  ■  S(3?i)  <  E(Y^)  <  Yj’  +  t  -  S(yj) 

where  Y^  =  a  +  b  x^ 

and  -  S2(a)  +  x2  •  S2(b);  a  O. 


Since  each  "a"  represents  an  average  of  3  numbers  and  each  "b"  represents 
an  average  of  9  numbers,  we  have: 


s2(?  ,  a  351  x  .2  rv,,„2 

'  i'  .  3  i  9  - - i 

These  ideas  are  illustrated  in  Figure  lO,  in  which  we  consider  Mix  C 
o  D 

and  a  temperature  of  O  ,  and  fit  the  curve  from  15  sec  <X  £L  45  sec, 

(Segment  C-D),  This  curve  is  given  by  Y  =  264  -  ,410  X.  or  Y  =  264-,  410- (X-30) 


]:»s 

7«?  3*  7«3S:i  JaUi  .51 1 


l  is  i 

ill 

Hi 


ilipii 


!"J I 15! I 5 • * ■  • 
•  ♦i  *  51  !  3  1  »  *  4**  *  !3!i!!*5  555!!*  a!  ■*! 


I  Fail!} 

SStS' 


1 1  “Sil1 

i!  n  V 

"m 


lifillb  iiiiimii  Ep! 
ill  ills  lisp 


s«i?» 
csss i  a 
aijji  a 


*»»»•• •«••• 


.1.3 - 2— 1IIHM  •  «•»•< 


•*  - - - - 

iiliiiiiiiiiiiiiiliiiiiilii! 
llllllHiilllillllllllillliiillnini: 
Sul  (SSiSss!  ;Si 

■■■■  ........  ---  ••■••■••iiiiiijijijifjifii 


illlSiillliiSiipillillllllillllli _ 

wmsmsMKM 


illllH  HFlilll!  I! 


:::  ::a:::c;:: 
£  !!!(!?! ;;;;; 


:: 

fis!  ui 

iiiliii  iiiiiiiiiiiiiiiiiiiiiiiiii 

... :  “ ::  : 

I  |s|  |jj * jjjijj |*il i  ii*i 


:;i  i  ::4: : :  :i' ::  s:S:i  i:;:i  Ui::  i::::  S:::: ::::  I 

u^HiIii!ljEin!Sil£linp!ili!!!iifiiUmi!Sii] 


(S9S) 


65 


Design  of  Experiments 

2,-.  2 

and  the  variance  S  (Y)  =  117  +  .033  X,  was  used  to  compute  a  confidence 
bound  about  the  curve.  Incidentally,  the  confidence  bound  in  Figure  lO  is 
very  close  to  the  One  illustrated  in  Figure  5. 

The  procedures  for  fitting  the  segments  (0-A)  and  (E-F)  could  be  quite 
similar  to  that  of  fitting  the  segment  (C-D).  In  fact  the  segment  (O-A) 
should  be  even  simpler.  To  fit  the  segment  (A~C),  it  is  suggested  that  a 
cubic  equation  be  fitted,  using  data  points  at  one  second  intervals.  It  is 
further  suggested  that  orthogonal  polynomials  be  used  when  fitting  a  cubic 
or  higher  degree  equation  to  simplify  the  process  of  obtaining  the  variance  ^ 
and  confidence  bounds. 

CONCLUSIONS.  F requently  it  is  desired  to  design  an  experiment  when 
the  results  of  the  test  are  a  continuous  curve  rather  than  a  single  quantitative 
value.  Scientists  and  Engineers  frequently  want  to  know  whether  certain 
levels  of  a  given  treatment  will  have  a  significant  effect  upon  the  curve 
obtained,  and  what  will  an  average  or  expected  curve  be  for  a  given  set  of 
conditions . 

I  have  made  a  few  suggestions  based  largely  upon  analysis  of  variance 
or  regression  analysis.  I  will  greatly  appreciate  comments  on  the  proposed 
solutions,  but  more  important,  1  would  like  suggestions  for  better  approaches 
to  the  problem. 

QUESTIONS. 

1.  Has  the  problem  of  designing  an  experiment  when  the  results  come 
as  a  continuous  curve  rather  than  a  single  value  ever  been  solved?  If  so, 
are  useful  references  available? 

2.  Do  you  have  any  ideas  of  additional  approaches  beside  those  sug¬ 
gested  in  the  paper? 

3.  When  studying  a  section  of  the  curve  such  as  C-D,  is  there  any 
justification  in  arbitrarily  selecting  a  set  of  times  between  C  and  D,  com¬ 
puting  the  thrust  at  each  of  these  times  for  all  available  curvex,  and  per¬ 
forming  an  analysis  of  variance  similar  to  that  given  by  Figure  4?  Perhaps 
ima  would  be  iri  order  with  certain  ciiangee  in  procedure. 

4.  Whal  procedures  would  you  suggest  when  attempting  to  locate  a 
point  in  terms  of  both  its  X  and  Y  components  and  then  obtaining  both 
confidence  and  tolerance  region  about  this  point? 


66 


Design  of  Experiments 


5.  Is  the  analysis  of  variance  for  a,  b,  and  r,  as  illustrated  in 
Figures  8  and  9  appropriate? 

6.  Have  you  any  suggestions  regarding  the  validity  of  the  technique  a, 
using  regression  analysis,  that  were  discussed  in  this  section? 


COMMENTS  ON  PRESENTATION  BY  PAUL  COX 


Walter  T,  Federer 

Mathematics  Research  Center,  United  States  Army 
University  of  Wisconsin,  Madison,  Wisconsin 

The  paper  presented  by  Mr.  Cox  is  written  in  a  somewhat  provocative 
manner.  I  appreciate  this  style  of  presentation  as  it  affords  the  Panel 
ample  opportunity  to  illustrate  several,  statistical  points. 

The  first  point  I  wish  to  make  relates  to  the  definition  and  use  of  terms 
in  current  statistical  literature.  There  is  a  tendency  in  statistical  litera¬ 
ture  for  vague  and  imprecise  usage  of  such  terms  as  the  design  of  experi¬ 
ments,  analysis  of  variance,  error  rate,  etc.  It  is  instructive  and  useful 
to  define  and  to  use  words  or  phrases  in  a  specified  manner.  Any  departure 
from  specificity  should  be  described.  Personally,  I  would  prefer  to  use 
definitions  of  the  following  form; 

i)  Experimental  design  (or  experiment  design)  -  The  arrangement  of 
the  observations  in  the  experimental  area  or  space  or  the  procedure  for 
obtaining  the  observations  in  an  experiment. 

ii)  Treatment  design  -  The  arrangement  or  selection  of  treatments  for 
the  experiment  (e.  g.  ,  the  selection  of  levels  and  combinations  of  factors 
iii  factorial  experiments,  etc.) 

iii)  Determination  of  sample  size  -  The  number  of  observations  necessary 
to  achieve  a  prescribed  objective.  (Authors  of  some  ranking  procedures 
papers  refer  to  the  determination  of  numbers  of  observations  as  the  design 
of  experiment  rather  than  as  the  determination  of  sample  size.) 

iv)  Analysis  of  variance  -  The  partitioning  of  the  sum  of  squares  into 
component  parts.  (One  segment  of  statistical  literature  utilizes  the  term 
analysis  of  variance  to  be  synonymous  with  an  F  test  while  another  seg¬ 
ment  utilizes  this  tei.  ■  to  refer  to  the  estimation  of  variance  components 
and  so  it  goes.  ) 

v)  Analysis  of  experimental  data  -  This  term  includes  the  last,  above 
uul  nui  vie u  vtraei,  li  its-icio  tu  all  a Lalia Llual  (joxupuiaiiun»  relevant  Lu  a 

set  of  experimental  data,  An  analysis  of  experimental  data  refers  to  the 
reduction  of  data  Lo  Nummary  form  and  is  useful  in,  but  does  not  replace, 
the  interpretation  of  experimental  results,  The  interpretation  of  statistical 
results  must  be  made  in  light  of  the  objectives,  conditions,  and  related 
circumstances  of  the  experimental  results. 
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vi)  Significance  level  -  Type  1  error  =  size  of  the  test  =  a,  have  all  been 
used  to  refer  to  the  same  thing  but  unfortunately  nothing  is  said  about  the 
base  for  computing  "a", 

vii)  Valid  estimate  of  the  error  variance  -  Fisher  has  defined  this  term 
but  unfortunately  many  statistical  writers  by-pass  this  important  concept 
with  the  phrase  "given  that  <r  is  the  error  variance.  0  In  much  of  experi¬ 
mentation  the  definition  of  error  variance  cannot  be  so  glibly  by-passed, 
but  requires  a  thorough  knowledge  of  the  experimental  conditions. 

We  could  go  on  with  other  terms  but  now  let  us  return  to  Mr,  Cox's 
paper.  The  title  of  the  paper  is  "Statistical  Design  of  Experiment  for 
Continuous  Data0)  it  deals  only  with  the  analysis  of  experimental  results 
with  no  reference  either  to  the  experimental  or  treatment  design  as 
defined  above.  Mr,  Hartley  has  discussed  some  considerations  to  be 
given  to  the  treatment  design  for  experiments  with  specified  objectives. 

Mr.  Lucas  will,  I  hope,  make  some  comments  about  the  actual  experimental 
design  used  in  this  study  and  illustrate  where  confounding  has  taken  place, 

Mr,  Cox’s  paper  is  concerned  with  what  to  do  with  a  set  of  data  and  not  with 
how  to  obtain  the  data,  He  has  raised  a  number  of  questions  but  rather  than 
address  myself  to  the  specific  question  I  prefer  to  proceed  in  another  manner 
which,  I  hope,  Will  furnish  answers  to  or  illustrate  the  relevance  of  the 
questions. 

As  Messrs.  Grubbs,  Greenberg,  Hartley,  and  Schneiderman  have 
already  stressed  we  must  first  set  up  a  Mathematical  Model  for  the  data 
which  will  be  consistent  with  the  experimental  and  treatment  designs  and 
with  the  nature  and  objectives  of  the  experiment,  For  example,  let  us 
|  suppose  that  thrust  =  y,  may  be  characterized  by  the  following: 

’ 

y  =  %  h  o) 

"  1 1  v?  y  a  iunction  - r  ccmT>cn5"t2  d2r.ctsd 

by  the  vector  of  time  components  denoted  by  the  vector  and  of  a 
set  of  parameters  denoted  by  the  vector  9.  Our  first  job  then  is  to  define 
to  nature  of  the  function.  If  we  are  totally  ignorant  of  the  response  curve 
then  we  could  use  a  form  of  polynomial  regression  as  follows: 

b 

E(v)  =  2  a.t1 

,  i 

1=0 
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where  (3,  is  the  regression  coefficient  and  t.  the  time  variable.  After 

we  are  satisfied  that  a  suitable  mathematical  formulation  of  the  problem 
has  been  made,  the  parameters  of  the  response  curve  are  estimated.  The 
analysis  of  the  estimates  may  be  made  using  the  results  of  R.  A.  Fisher 
(Jour.  Agric.  Sci.  11:107,  1921  and  Phil.  Trans.  Roy.  So c.  B,  213:89,  1925) 
and  others.  Also,  multivariate  analysis  procedures  may  be  pursued  for 
summarizing  the  resuits  for  many  estimates  of  a  set  of  parameters.  For 
example,  if  it  is  desired  to  discriminate  between  response  curves,  then  an 
a  priori  or  an  a.poaterlori  (These  terms  are  not  reserved  solely  for  use.  by 
Bayesians.)  weighting  of  coeffiehts  in  the  discriminate  function  may  be 
utilized. 

As  a  part  of  the  characterization  of  the  model  and  of  the  problem  it 
should  be  determined  if  the  total  response  curve  segements  of  the  total 
curve,  or  specified  points  (e.  g.  points  of  inflection)  ,on  the  curve  are  of 
interest.  After  this  has  been  specified  then  the  statistician  proceeds  with 
the  estimation  problems,  Haziness  on  form  or  type  of  response  desired 
leads  to  a  confusion  of  issues, 

One  specific  question  raised  by  Mr.  Cox  related  to  the  sample  size  N 
for  response  curves  for  continuous  data.  Now  if  the  data  are  truly 
continuous  N  =  infinity,  but  we  al.l  know  that  the  recording  machine  records 
an  impulse  over  a  measurable  period  of  ame,  say  one-tenth  of  a  second. 

In  any  event  N  is  very  large.  Several  of  the  previous  Panel  speakers 
have  discussed  the  non-independence  of  two  successive  impulses  or  record¬ 
ings  by  a  recording  machine.  However,  I  wonder  about  the  relevance  of 
this  since  we  use,  or  should  use,  these  values  only  to  estimate  the  paramete 
in  the  response  curve.  This  procedure  is,  or  should  be,  repeated  for  many 
response  curves  and  the  variation  among  response  curves  treated  alike 
forms  a  basis  for  the  variances  and  covariances  among  the  estimates  of 
parameters  where  each  response  curve  represents  but  one  observation. 


At  this  point  1  do  not  see  the  importance  of  obtaining  a  variance  of  a 
Bingle  response  curve,  However,  if  such  is  desired,  then  as  an  approxi¬ 
mation  I  would  suggest  segmentation  of  the  total  curves  into  small  segments 
nf  time  where  small  is  such  that  the  estimates  are  relatively  uaoffeoted  by 
smaller  segmentation.  Course  groupings  could  affect  the  results  consider¬ 
ably.  Some  account  may  need  to  be  taken  of  the  relationship  among  adjoin¬ 
ing  segments  as  described  by  Messrs.  Greenberg  and  Hartley. 
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The  response  curves  presented  in  the  paper  bother  me  somewhat, 
Frankly,  I  believe  (i)  that  the  curves  in  Figure  3  are  not  very  fictitious, 

(if)  that  the  area  under  each  curve  is  relatively  constant  from  the  conaerva- 
tion  of  mass  theory,  (iii)  that  a  heart-to-heart  talk  with  the  physicists  and 
engineers  would  do  much  to  simplify  the  nature  of  the  problem,  and 
(iv)  that  maybe  Mr.  Cox  should  be  considering  acceleration z  instead  of 
thrust  =  y.  i' 

Summed  up  this  means  that  I  would  want  some  education  in  this  'ferea 
before  any  analyses  would  be  performed  on  thrust  or  any  other  data.  It 
may  be  possible  to  reparameterize  the  problem  by  using  a  function  of  the 
time  variable  instead  of  the  time  variable  itself.  Some  simple  function 
such  as  log  t  might  suffice.  : 
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Bernard  G.  Greenberg 
t  School  of  Public  Health 

The  University  of  North  Carolina 
Chapel  Hill,  N.  C, 

As  the  first  discussant,  my  main  concern  will  be  with  what  I  consider  the 
the  most  important  aspect  of  this  problem.  It  involves  the  question  of  the 
basic  underlying  model  and  what  the  purposes  of  the  investigator  were  in 
designing  this  experiment.  As  our  chairman  has  just  pointed  duti  this  is  our 
primary  consideration. 

This  example  illustrates  what  I  think  is  a  truism  in  statistical  design 
and  experimentation,  viz.  that  no  amount  of  statistical  knowledge  and 
methodology,  however  great,  is  a  sufficient  substitute  of  substantive 
knowlege  of  the  field  of  application  and  in  being  able  to  discuss  with  the 
investigator  the  important  questions.  For  instance,  Mr.  Cox  has  indicated 
that  his  six  points  were  arbitrarily  selected  and  the  analysis  of  variances 
relating  thereto  were  not  necessarily  fheaningful.  This  may  be  so  in  these 
six  points  but  does  the  person  who  has  the  expert  knowledge  of  thrust  curveB 
tend  to  associate  important  meanings  to  them,  or  any  other  set  of  critical 
points.  It  may  very  well  be  that  point  A  has  direct  application  to  the  under¬ 
standing  of  the  model  underlying  thrust  curves  and  that  the  actual  value  of 
A,  the  time  elapsed  from  the  origin,  or  the  rate  of  ascent  from  the  origin 
to  A  are  of  primary  concern  to  the  rocket  motor  designer, 

6'  _  .  '  •  .  ‘  - 

This  is  bast  illustrated  from  examples  in  my  own  field  of  biology  and 
medicine.  We  have  similar  kinds  of  data  which  may  not  be  as  closely 
continuous  as  the  thrust  curve,  but  the  points  of  observation  in  the  time 
series  are  spaced  close  enough  together  that  we  treat  them  as  such.  Thus, 
vye  have  tracings  for  electrocardiograms,  growth  curves,  and  epidemic 
curves.  In  the  electrocardiogram,  the  distance  and  regularity  between  two 
waves  is  extremely  important  to  the  cardiologist  and  deviations  from  normalcy 
are  based  upon  this  pattern,  In  an  epidefnic  curve,  we  are  interested  in  the 
length  of  time  between  peaks  shch  as,  in  the  periodicity  of  measles.  We  are 
also  interested  in  the  amplitude  of  the  waves  in  order  to  know  expected 
numbers  of  cases. 

In  other  words,  without  discussing  with  the  engineer  of  the  rocket  motor 
thrust  curve  what  his  problem  is.  it  is  difficult  for  me  to  know  how  to  handle 
best  these  data.  It  may  be  the  measurement  of  the  critical  points,  the 
length  of  time  until  each  maximum  is  Attained,  or  even  the  integral  summing 
up  the  total  amount  of  thrust. 
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If  one  is  convinced  that  he  does  want  to  fit  a  mathematical  equation  to 
this  curve,  or  segments  of  it,  a  nasty  problem  arises  because  of  the  time 
series  nature  of  the  data.  The  observations  in  time  are  not  independent  and 
the  residuals  riiay  be  autocorrelated.  This  is  not  a  new  problem.  The 
econometricians  have  been  considering  this  problem  for  years  in  their 
analysis  of  time  series. 

I  might  suggest  one  reference  to  Mr.  Cox  in  this, connection  which  may 
help  in  fitting  equations  to  segments  of  the  curve  and  the  analysis  thereof. 

A  paper  by  Elston  and  Grissle  (Bidmetrics,  Vol.  18)  No.  2,  June  1962, 
pp.  148-159.)  considers  the  various  ways  of  estimating  time-response 
curves  and  the  ideas  in  that  paper  should  prove  helpful  in  this  problem.. 


s  COMMENTS  ON  PRESENTATION  BY  PAUL  COX 

i  - 

H.  L.  Lucas 
Institute  of  Statistics 
North  Carolina  State  College 
Raleigh,  North  Carolina 

e  1  The  'panelists  so  far  have  covered  just  about  everything  that  I  had  in 
mind.  I  certainly  agree  in  the  main  with  the  comments  they  have  made 
regarding  just  what  particular  points  on  the  observed  curve  or  what  parti¬ 
cular  function  of  the  observations  may  be  of  interest.  Also,  I  agree  with 
the  comments  regarding  the  desirability  of  fitting  a  "rational"  model, 
which  presumably  can  be  supplied,  at  least  In'  approximate  form,  by  the 
engineers.  I  wish,  however  to  expand  on  a  very  important  point.  "• 

"  .  ;  a  . 

■I  1  ■  .  .  , 

Many  of .remarks  of  panelists  about  design  and  analysis  have  been 
engendered  by  the  existence  of  “noise 11  along  tHb  curve  fori'Ani  Individual 
motor  and  the  probable  lack  Ipf  Independence  of  successive  observations. 

I  wish  to  emphasise  that  thejV*  is  another,  and  probably  much  more  import 
ant,  “noise11  component  invoiced.  /The  latter  arises  from  the  fact  that  a 
group  of  motors  which  are.,ci//h)*u;ructed  and  treated  alike,  insofar  as  can  be 
managed,  will,  neve rrhele*^,1  have  Inherently  somewhat  different  curves. 
That  is,  there  is  "betweeoi*5$otor“  noise  as  well  as  “within-motor1*  (along- 
the-curve)  noise.  The  existence  of  between-motor  noise  must  be  taken 
into  account  for  proper  experiment  design  and  analysis, 

It  Is  instructive  to  formalise  the  situation  in  a  way  which  ertcompases 
the  two  noise  components.  For  the  jth  experimental  unit  (here  the  motor, 
but  in  other  cases  a  machine  or  an  animal,  etc. )  on  the  1th  treatment,  we 
can  Write  the  model, 


(1) 


VijCt)  a  lij)  +‘ij(t) 


where 


y  (t)  =  observed  time  curve  for  the  unit 
(t; 9^)  -  “true”  time  curve  for  the  unit 
9^,  =  vector  of  parameters  for  the  unit 
c^(t)  *  “within-unit“  noise. 


V,  ‘f/w  c*„5,V'. 
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Note  that  =  6^  is  the  total  noise  or  error  in  and  sterna  from 

both  "between"  and  "within"  noise. 

In  view  of  the  development  just  completed,  it,  is  certainly  reasonable 
first  to  estimate  0..  for  each  individual  unit  and  then  as  a  second  step,  to 

analyze  the  according  a»  the  experimental  design  dictates,  Since 

is  a  vector,  multivariate  methods  may  be  desired,  Note  that  the  procedure 
is  a  "robust"  one. 

r  i  §°in®  P,aP?r.®  in  which  the  "robust"  approach  has  been  employed  are 
[4  [3],  I4],  (5],  (4  y 

In  view  of  the  remarks  of  some  of  the  other  panelists  about  choice  of 
points  along  the  time  curve  and  about, correlation  between  successive 
observations  along  the  curve,  the  following  comments  seem  in  order.  In 
my  experience,  the  contribution  of  the  "between"  noise,  6  ,  to  the  > 

^  1  •  •  “lj 

variance  of  8^  as  an  estimate  of  is  dominant  over  the  contribution  of 

the  "within"  noise  as  summed  up  in  In  fact,  in  some  instances,  the 

"between"  noise,  6^,  is  large  relative  to  the  "within"  noise!;  «  (t), 

itselfi  in  this  event,1  the  contribution  of  ^  is  negligible.  With  6^, 

dominant  over  ,  it  is  clear  that  one  need  not  worry  much  about  the 

correlation  between  successive  observations  on  the  same' unit,  that  any 
reasonable  method  of  computing  ^  will  do,  and  that  one  needs  use  only 

the  minimum  number  of  points  along  the  ijth  curve  consistent  with  the 
complexity  of  $  and  the  obtaining  of  moderately  efficient  estimates  of  g_^. 

This  leads  next  to  the  design  problem,  a  matter  which  has  been  die- 
cussed  by  the  other  panelists  primarily  from  the  standpoint  of  selecting 
points  along  the  time  curve.  In  view  of  my  foregoing  remarks,  I  cannot  II 
see  that  the  pattern  for  selection  of  points  along  the  time  curve  is  the 
i“«aUy  matter,  just  as  long  as  the  pattern  is  a  reasonable  one. 

Instead,  the  important  question  is  how  to  select  an  optimurh  set  of  treat¬ 
ment  combinations. 

To  comment  further  about  the  design^problem,  it  is  again  advantageous 
to  he  somewhat  formal.  We  note  that  is  a  function  of  the  levels  of  the 
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treatment  variables  (here,  temperature  and  mixture):  i.  u.  , 


=  iter  ±) 


where 

y  =i  a  vector  of  functions  of  the  vectors  and  a 

=  t^e  vector  of  levels  of  the  treatment  variables  characterizing  the 
i  treatment) 

"  a  =  a  vector  q£  parameters  which  depends  on  basic  invariant*  and  on 
the  levels  maintained  for  treatment-type  factors  not  under  study 
(i.e.,  factors  held  constant  over  all  i). 

Substituting  (.6)  into  (5)  yields 


tij  “  *(*!>  3.)  +  iij 


Nov,  if  the  functional  forms  represented  by  £  are  known,  the  problsmis 
to  select  a  minimum  optimal  set  of  x-vector«  such  that  all  elements  of  a 
can  be  estimated  and  that  the  estimate,  £,  Is  "best”  in  a  suitable  sense? 

In  general  the  optimum  design  depends  on  a,  but,  since  a  is  unknown, 
one  musi'use  previous  estimates  (or  best  guesses)  about  a  in  order  to 
arrive  at  a  good  design.  Some  ideas  about  this  problem  are  given  in  [2], 

If  the  forms  of  the  functions,  are  subject  to  question,  the  design  must 
have  extra  x-vectors  so  that  tests  about  the  assumed  £  and  insight  about 
improvements  can  be  obtained.  The  latter  point  is  also  discussed  briefly 

,in[2]-  '  -  S::;  .... 

I  have  finished  tlwmsm  f-hing*  1  «/»nt to  say.  Thors  ere,  however, 
a  couple  of  other  matters  that  come  to  .mind.  ,. 

The  first  has  to  do  essentially; with  what  function  of  (j>  and  hence  of 
y,j(t)  is  really  of  concern  to  the  investigator.  Although,  in  some  instances, 

only  a  particular  univariate  function  of  <|>  may  ever  be  Of  interest,  my 
experience  indicates  that  this  is  not  generally  true,  I  suggest,  therefore^ 
that  ordinarily  it  will  be  be*!  to  study  <p ;  i.e.  ,  to  fit  the  parameters,  ©.  , 


I 
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or  more  basically,  a.  Given  such  fits,  anything  desired  can  be  ascertained, 

Finally,  in  the  first  analysis  Mr,  Cox  outlined,  he  failed  to  distinguish 
"between1*  and  "within"  noise,  The  variance  sources  for  his  analysis  were 

Treatment  • 

Time  ;  ;  '  '■  ■ 

Time  by  treatment  •  ^ 

Residual* 

They' should  have  been 
Treatment 

*  ”  .  •  ,  ■  . 

Motor  within  treatment  (Error  for  treatment)  corresponds  to  6^ 

Time 

Time  by  treatment 

Time  by  motor  within  treatment  (Error  for  time  and  time  by  treatment; 
coresponds  to 


In  closing,  I  should  note  that  Mr  ,  Con,  in  all  but  his  first  analysis, 
adopted  the  "robust"  approach,  I  stress  the  approach,  however,  because 
it  is  important,  and  because  Judging  from  his  first  analyeis,  Mr.  Cox 
appeared  not  to  be  very  clear  on  the  implications  of  the  ixlstehce  of  both 
"between"  and  "within"  noise, 


M 
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Iowa  State  University 
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;!  ' 
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As  the  last  of  the  discussants  to  give  my.  comments  in  writing  I  have  the 
advantage  of  a  preview  of  what  my  predecessors  have  said.  I  will  attempt 
to  summarize  and  amplify  their  competent  comments, 

Mr.  Cox  has  certainly  described  a  problem  which  has  raised  many  . 
questions  of  considerable  interest.  His  problem  is  Concerned  with  the 
design  and  analysis  of  an  experiment  in  which  the  'response'  is  measured 
in  the  form  of  a  curve  (thrust  curve  of  a  motor  is  hia  example).  Actually 
Mr.  Cox  is  almost  exclusively  concerned  with  analysis.  I  Will  later  make 
a  lew  remarks  on  the  design  aspect. 

Let  me  start  by  saying  that  we  cannot  really  talk  about  an  'appropriate 
analysis'  of  a  set  of  experimental  response  curves  without  being  clear 
about'  ^ 

(a)  The  purpose  or  the  objectives  of  the  experiment 

and  at  least  to  some  extent  about  . 

(b)  The  physical  mechanism  generating  the  experimental  responses, 

With  regard  to  (a)  Mr.  Cox  has  described  easentiJidly  : 

the  effect  of  'Conditioning  Temperature'  and  'Mix'  on  the  'Shape  of  the  Thrust 
Curve*  and  the  'Total  Impulse*.  The  latter  is  a  single  response 'clearly 
defined  as  an  integral  of  the  response  curve  and  obtainable  (say)  by  numerical 
integration.  The  latter  requires  clearer  definition  in  terms  of  thrust  curves 
characteristic  of  real  interest  to  the  engineer  and  to  be  specified  by  him. 

We  may  speculate  that  one  of  these  may  be  the  initial  rate  at  which  the  thrust 
increases  from  zero,  or  possible  the  time  at  which  it  reaches  the  stationary 
Stage,  etc.  Mr.  Cox  has,  however,  pointed  to  an  important  feature,  nan^ely 
that  in  general  a  multiplicity  of  responses  will  have  to  be  computed  from  "the 
curve  representing  the  relevant  summaries  of  interest  to  the  engineer, 
Following  Dr.  Lucas's  notation  and  denoting  by  y..(t)  the  thrust  fo r  the  j 

■  ‘J  .  _ 

unit  of  the  treatment  group  observed  at  time  t,  we  would  compute  for 
each  curve  k  summaries  Sr(y^(t));  r  =  1,  2,  ,  ,  . ,  k,  which  in  this  example, 

may  well  be  computed  from  standard  formulas  of  numerical  Integration  and 

differentiation.  To  answer  the  purpose  of  the  experiment  we  may  in  many 

cases  apply  the  well  established  techniques  of  multivariate  (kivariate) 

analysis  of  variance  (see,  e.  g, ,  Smith,  H;  Gnanadestkan.  R,  and  Hughe«;  .T  n 

(1962))  to  the  S  (y  (t))  which  would  h«  a  3x3  factorial  (i)  by  temperature 
r  ij  r 
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and  mix  with  3  replicate  units  (j)  in  each  cell.  Much  of  the  information 
will  often  be  pbtainable  from  a  standard  single  variate  analysis  of  vari¬ 
ance  applied  to  each  of  the  S  (y.,(t))  separately.  This  sort  of  analysis 
which  usee  a'between  unit  error*3 is  also  recommended  by  Dr.  Lucas  and 
Dr.  Federer,  called  'robust*  by  the  former,  and  is  in  essence  identical 
with  Mr.  Cox's  analysis  of  variance  for. the  Regression  intelccfept,' 
a,  and  slope,  b,  fitted  to  a 'straightlooking'  section  of  the  curve.  1 
question,  however,  whether  Mr.  Cox's  procedure  of  'arbitrarily'  breaks 
ing  up  the  cvirve  into  sections  and  fitting  polynomials  separately  to  the 
sections  really  contributes  to  our  appreciation  of  the  engineering  aspects 
Is  it  really  of  interest  to  the  engineer  that  a  cubic  term  in  the  first  section 
goes  up  with  temperature?  To  my  mind  it  is  of  Lite  greatest  importance 
to  communicate  with  the  engineer  on  the  selection  of  relevant  summaries 

sr(yij(t))- 

This  brings  me  to  (b),  namely,  the  importance  of  a  physical  theory 
leading  to  a  mathematical  model  for  the  thrust  y^(t),  stressed  by  all 

discussants,  Dr.  Lucas  postulates  a  model  of  the  form 


(1) 


f.  (t{ 


V* 


where  0  is  a,  (lay)  m  vector  of  parameters,  Whilst  in  the  present 
example  it  should  be  quite  feasible  to  obtain  such  a  model  from  (say)  the 
differential  equations  governing  the  dynamics  of  the  thrust  phenomenon, 
the  statistician  may  be  called  upon  to  analyze  curves  arising  in  a  situation 
in  which  the  setting  up  of  a  mathematical  model  is  difficult.  I  would 
stress,  therefore,  that  summaries  Sr(y^(t)j  answering  the  purpose  of  the 

experiment  can  often  be  decided  upon  without  reference  to  a  mathematical 
model,  although  the  study  of  their  statistical  efficiency  is  facilitated  by  the 
mode.  Where  the  latter  is  available  one^may  proceed  M  fir,  Lucas  suggests 
to  estimate  the  'treatment  averages'  of  the  although  it  may  be 

argued  to  be  more  appropriate  to  estimate  the  treatment  averages  of  the 
relevant  summaries  Sr(<fi  (t;  ©.j)  the  two  being  differentially  equivalent. 

Whatever  method  is  used  I  believe  that  some  attention  should  be  given  to  the 
estimation  of  the  individual  units',  ©^j,  and  this  raises  the  question  of  the 
'within  curve'  error  or  noise.  I  agree  with  Dr,  Lucas  that  this  will  often  be 


i 
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relatively  unimportant,,  tiowever,  it  is  of  the  same  degree  of  relevance  jj 
as,  for  example,  the  estimation  of  the  mean  life  for  a  time  mortality  curve 
or  the  D.  50  of  a  dosage  mortality  situation  both  of  which  are  usually 
'within  curve'  estimation  problems  and  both  have  received  considerable  l! 
(possible  exaggerated)  attention  by  statisticians.  1  will,  therefore,  answer 
the  question  raised  by  Mr,  Cox  concerning  the  Within  curve  error  Structure! 
--The  'degrees  of  freedom'  that  are  to  be  attached  to  a  set  of  rislduals 
y,,(t  )  -  <|>(  t  ,  9.,)  computed  at>  some  arbitrarily  selected  t.ime  points,  t  , 

ij  b  .  s i  w  ■* 

appear  to  depend  on  the  choice  of  the  t  .  Because  of  the  time  series 
correlogram  the  sum  of  squares  of  residuals 


<rtj(t,)  -  ey)) 


is  approximately  distributed  as  dX  based  on  an  'effective  number'  of 
degrees  of  freedom  (see,  e.  g. ,  Bayley  and  Hammersley  (1946))  and  ideally 
.jjthis  should  be  invariant  with  the  choice  of  grid  points,  t^.  Without  the 

knowledge  of  the  correlogram  orte  cannot  judge  how  the  degrees  of  freedom 
of  Mr.  Cox's  Figure  4  are  affected.  However,  the  analysis  given  in  this 
figure  in  any  case  doeB  not  take  proper  account  of  the  distinction  between 
(within  curve'  and  'between  curve  errors'  as  was  pointed  out  by  Dr,  Lucas, 

Finally  a  few  words  on  the  question  of  the  design  of  an  experiment  with 
curve  responses.  First  let  me  say  that  the  choice  of  t  values  is  not  a 
question  of  the  design  (as  Dr.  Lucas  rightly  stresses  but  as  far  as  1  recall 
nobody  said  so  during  the  discussion).  This  is  a  computational  question  of 
analysis.  The  design  is  concerned  with  the  choice  of  the  levels  of  'tempera¬ 
ture1  and  the  composition  of  the  mixes  or,  indeed,  with  questions  of  what 
treatment  combinations  should  be  chosen.  Since  the  work  by  Box  and  Draper 
(1959)  and  Kiefer  (1959)  and  others  is  mainly  concerned  with  a  single 
experimental  response  or  a  single  response  surface,  much  needs  to  he  done 
about  designing  experiments  which  in  some  sense  are  optimum  for  the 
'assessment*  of  multiple  response  surfaces,  particularly  if  (as  is  the  case 
with  Mr.  Cox's  example)  some  factors  (mix)  are  qualitative.  In  the  absence 
of  a  comprehensive  theory  one  would  perhaps  single  out  one  important 
response  from  the  S  (y,,(t))  and  optimize  the  design  for  housing  some 
such  theory  as  the  aboveJbut  optimizing  subject  to  tolerances  for  the  bias  and 

•M  — —  —.4  X  -«ir  aa  ^  A-  4*  1  Vb  a,  bm  m  -B.  a*  m  m.  a*  a  a  u,/  M  £'*m  aa  A-  -j,i  -m,  a  i.  B»  aa  a  M  mm  —  M  a  |B  M  £  n  a  n  __  «  BB 
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be  estimated.  .  .  '  i; 
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COMMENTS  ON  PRESENTATION  BY  PAUL  COX 

Marvin  A.  Schneiderman 
Biometry  Branch,  National  Cancer  Institute 
National  School  of  Health,  Betheada,  Maryland 

It  Is  always  a  pleasure  (and  enlightening)  to  attend  a  statistical  session 
in  which  Professor  Greenberg  and  Professor  Hartley  participate,  They 
usually  make  important  remarks,  succintly,  and  thus  save  one  from  the 
responsibility  of  adding  much  more  than  ’'amen.  "  Since  they've  spoken 
before  me,  I  wish  now  to  add  my  "not  much  more*,  (as  well  as  "amen”). 

Mr.  Cox  has  presented  us  with  a  very  interesting  problem  in  engineering 
which  has  a  direct  counterpart  in  medical  and  biological  research,  I  have  In 
mind  among  other  measures  the  interpretation  of  electrocardiogram  tracings, 
electro 'encephalogram  tracings,  and  the  Hood  of  apparently  continuous  mea- 
sure*  that  the  physiologists  are  now  capable  of  making.  From  this  analogy, 

1  am  led  to  take  alight  issue,  however  with  one  of  Professor  Hartley's 
remarks.  / 


A  single  response  measure,  such  as  the  LD^  may  well  be  inappropriate. 

Of  course,  Mr.  Cox's  engineer  has  been  rather  vague  about  what  he  really 
wants  to  know,  and  1  suspect  that  more  extended  discussion  with  the 
statisticians  might  lead  the  engineer  to  specify  his  problem  more.  I  am 
guessing  that  an  LD^  would  be  inappropriate.  Assume  that  the  statistician- 
finds,  though,  that  Ke  is  interested  in  the  shape  of  the  curve,  in  some  eenae. 
That  is,  the  specific  shape  of  the  curve,  or  the  presence  or  absence  of  some 
specific  wiggle  tells  him  something  about  the  physics  underlying  the  system. 
For.  example,  in  the  biological  counterpart,  a  straight  line  inactivation  curve 
(log  response  vs.  time,  for  example)  as  was  first  postulated  for  the  Salk 
vaccine  for  polio  implies  a  simple  one-step  chemical  process,  or  a  single 
manner  of  excretion,  A  concave  upward  curve  may  imply  a  two-step  pro¬ 
cess,  or  two  (or  more)  modes  of  excretion,  (1.  e.  a  sum  of  exponentials)  or 
some  other  functional  arrangement.  The  investigation  of  the  kinetics  of 
such  systems  are  a  whole  sub-field.  Professor  Hartley  has  some  good 
advice  to  offer  in  the  fitting  of  these  sums  of  exponentials.  Thus,  the  curves 
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should  not  be  lost. 


..  '  ....  V  . 

On  the  specific  suggestions  made  %  Mr.  Cox  for  the  analysis  of  the  data, 
the  physical  meanings  of  the  various  points  on  the  curve,  A,  B,  C,  D>  E,  F, 
might  help  guide  the  statistician  into  more  fruitful  lines --perhaps  even  into 
a  solution  of  the  problem  the  enaineer  wants  solved,  As  Professor  Hartlev 
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pointed  out,  the  points  on  the  curve  are  correlated,  making  the  analysis  of 
variance  inappropriate  because  of  the  non-independence.  One  earlier  refer¬ 
ence  on  the  non-independent  regression  problem  then/the  Bailey-Hammersley 
reference  that  may  be  helpful  is  one  by  John  Mandel,  in  the  Journal  of  the 
American  Statistical  Association  "Fitting  a  straight'  line  to  certain  types  of 
cumulative  data,  "  Vol.  52,  p.  552  (1957).  My  recollection  is  that  Mandel 
shows  that  a  least  squares  approach  gives  an  unbiased  estimate  of  the  para¬ 
meters,  but  gives  the  wrong  (too  small)  variance.  He  gives  other  refer- 
enc.es  to  this  problem,  too. 

On  the  "shape"  problem,  there  is  a  paper  by  Q.E.P.  Box  and  W.  A,  Hay 
which  may  be  of  interest,  It  appeared  in  Biometrics,  Vol.  9,  p.  304  (1953) 
"A  statistical  design  for  the  efficient  removal  of  trends  occurring  in  a 
comparative  experiment,  with  an  application  in  biological  assay.  *  A  recent 
doctoral  dissertation  by  Francis  J.  Wall,  from  the  University  of  Minnesota 
considers  an  aspect  of  the  nearly  continuous  data  problem  in  biology  and 
medicine.  The  title  is  "Biostatistical  linear  models  in  longitudinal  madlcM 
research  problems.  "  The  title  shouldn't  mislead  snginsers.  It's  much  the 
same  problem  as  we  had  here. 
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THE  INDEPENDENT  ACTION  THEORY  OF  MORTALITY 
AS  TESTED  AT  FORT  DETRICK 

Francis  Marion  Wadley 
U,  S,  Army  Biological,  Laboratories 
Fort  Detrick,  Frederick,  Maryland  •; 

The  independent  action  theory  is  Sometimes  used  as  an  approach 
to  all -or  none  dosage-effect  problems  instead  of  the  more  usual  doe- 
age-effect  methods  such  as  probit  analysis,  With  the  probit  and  sim¬ 
ilar  analyses,  the  basic  assumption1  is  of  varying  susceptibility  among 
the  subjects.  With  the  independent  action  theory  in  its  simplest  form 
the  assumption  is  that  any  toxic  unit  reaching  the  site  of  action  will 
be  effective.  Each  unit  is  believed  to  have  a  small  but  definite  chance 
of  hitting  Us  mark;  a  higher  percentage  response  to  larger  doses  is 
produced  by  multiplication  of  this  chance,  This  theory  obviously 
does  not  assume  varying  susceptibility  among  subjects,  and  will 
logically  lead  to  the  same  slope  for  all  trials.,  If  a  is  the  chance  of 
hitting  the  mark,  the  chance  of  escape  is  (1-a)  for  one  toxic  unit;  for 
2  units,  it  is  (1-a)2  ;  for  n  units  (l-s.)n.  Danger  from  bullets  on  a 
battlefield  has  been  used  as  one  illustration, 

'  '  .  ,  «  ”  '  ,  .  '  ■  '  ■  • 

The  independent  action  theory  was  apparently  first  developed  by 

Neyman  and  associates,  according  to  K.  L,  C alder  of  Fort  Detrick. 

It  has  been  used  by  Watson  (Phil.,  Trans,'  Roy.  See,  London,  1936)  in 
studying  transmission  of; plant  viruses  by  Insect  migrants.  ■  It  Is  also 
used  by  some  workers  in  dosage -effect  studies  where  the  dose  is  of 
biological  agents  (S,  Pete,  Biometrics  1953;  L.  J,  Goldberg  and 
associates,  Sth,  8th. and  other  reports,  Navy  Biol.  Lab,  ,  1951-52), 

A,  W,  Kimball  (1953  lectures,  Fort  Detrick)  has  applied  the  theory 
to  radioactive  particles,  Peto  presents  detailed  procedure  for  cal¬ 
culation,  and  mathematical  methods  are  also  presented  by  Andrews 
and  Chernoff  (Tech,  Rapt,  17,  Applied  Math  Lab,  Stanford,  1932), 
and  by  W.  G,  Cochran  (1946  lectures,  N,  C.  State),  Goldberg  (1,  c, ) 
has  worked  out  special  plotting  paper  for  quick  graphic  estimation 
of  LD-BO  and  Its  error,  The  extensive  work  on  dosage  theory  assum¬ 
ing  varying  susceptibility  is  conveniently  summarised  by  Finney. 
("Probit  Analysis",  Cambridge  U,  Press,  1952), 

Where  such/ agents  as  bullets  and  radioactive  particles  are  con¬ 
sidered,  thet|e  can  be  no  question  that  the  idea  of  independent  action 
will  apply  better  than  the  concept  of  dosage  and  varying  susceptibility. 
With  chemical  toxicants  which  can  be  measured  out  accurately,  the 
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idea  of  dosage  and  varying  susceptibility  undoubtedly  applies  better 
than  the  independent  action  concept.  Susceptibility  is  know  to  vary. 

With' biological  agents  such  as  pathogenic  bacteria,  we  are  on  a 
midflue  ground  where  either  procedure  may  have  its  advocates.  The 
basic  question  appears  to  be  whether  susceptibility  really  varies  sub¬ 
stantially  among  subjects.  If  sortie  individuals  can  use  thBir  provisions 
for  combating  invading  agents  to  throw  off  effects  of  a  moderate  dose 
of  organisms*  while1  weaker  subjects  will  succomb;  the  drdinary 
dosage  treatment  should  auply. 

"  The  exponential  approach  obviously  simplifies  mathematical 
treatment  of  data,  and  in  its  simpler  forms  will  allow  calculation  of 
an  LD-50  from  only  one  concentration  giving  partial  mortality. 
Allowance  can  be  made  for  varying  susceptibility,  but  in  so  doing, 
simplicity  if  forfeited  and  advantages  Over  probit  analysis  seem  dubious. 

4  .■■■  "  '  . " 

With  data  of  Fort  Detrick,  Goldberg's  approach  has  given  LD-50 
estimates  very  similar  to  those  from  probit  analysis.  The  graphic 
error  estimates  of  his  early  publications  seem  inadequate,  Where 
several  concentrations  give  partial  mortality,  Goldberg's  graphic 
method  will  yield  several  LD-50  estimates  for  the  same  experiment.  / 
These  sometimes  very  incongruously  for  agents  with  charaateri#tically 
low  slope.  ■  ,  u. 

{  Critical  test  comparing  the  two  approaches  are  very  difficult 
since  for  ordinary  experiments  with  small  numbers  results  are  apt 
to  be  quite  similar.  One  possible  teat  involves  the  form  of  the  untrans¬ 
formed  dosage -percentage  curve,  With  the  typical  probit  curve  we 
have  an  asymetric  sigmoid  with  a  weakly  defined  but  real  lowe  bend. 
With  the  exponential  we  have  a  single-bend  curve  of  decreasing  steep¬ 
ness.  Demonstration  of  a  lower  bend  in  the  rone  of  low  mortality 
would  be  evidence  for  the  probit  approach,  but  would  require  hundreds 
of  animals.  In  general,  critical  test  wo  id  be  expensive  and  would 

ImmmmJm  iL  a  MeaweAsn  v*  X  umaiIaiI  M«iaA(-lAa1  W  a  a  at 
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limited  largely  to  gleaning  evidence  from  practical  teste. 

A  preliminary  test  was  afforded  in  1953  by  Fort  Detrick  data 
originated  by  A,  N,  Gorelick,  of  a  number  of  toxic  bacterial  injec¬ 
tions  into  mice,  (See  S,  B,  Job  No,  433,  Fort  Detrick).  Some  43 
points  based  on  435  animals  were  available.  If  proportion  of  survi¬ 
val  (q)  with  dosage  n  is  estimated  as  (1  -a)n,  then 
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log  q  =  n  log  (1  -a)  . 

and  dosage  should  be  linear  in  relation  to  log  survival.  Significant 
departure  from  linearity  should  suggest  that  the  logical  basis  of  the 
independent  action  theory  is  weak  in  this  material. 

On  plotting  log  survival  against  dose,  a  gentle  curve  was  suggested 
by  the  chart.  On  fitting,  a  simple  pa.rabola  gave  a  significant  gain  dver 
a  straight  line.  Statistics  are  as  follows; 

Source  of  Variation  Degree  of  Freedom 

Linear  1 

Quadratic  (Additional)  1  ' 

Residual  40 

Another  test,  not  of  a  definite  dosage  affect  study,  but  of  some 
assumptions  related  to  those  of  the  independent  action  theory,  was 
afforded  by  some  of  W,  C.  Patrick's  data  at  Fort  Detrick.  It  in¬ 
volved  an  encephalomyelitis  virus  injected  intra-cerabrally  into  mipe. 

A  large  number  of  test,  made  routinely  in  development  work,  were 
available.  The  agent  is  very  toxic  to  mice,  when  injected  intra- 
cerebrally  at  0,03  ml  of  high  dilutions.  The  regularity  of  results  has 
lodjjto  some  thought  that  any  single  infective  particle 'reaching  the  site 
of  action  may  be  fatal,  .  : 

Following  this  theory,  in  the  high  dioutlons  allowing  survival,  the 
survival  is  thought  to  be  due  simply  to  the  fact  that  the  small  sample 
taken  for,  injection  contains  no  particles,  This  would  imply  a  Poisson 
distribution  of  particles  among  such  samples,  with  a  rather  small  mean. 
This  would  throw  us  bfcck  on  the  Independent  action  or  "one-shot"  theory 
of  tbxicity, 

Patrick's  numerous  records  offered  a  chance  to  teBt  this  theory. 

If  infective  particles  have  a  Poisson  distribution  among  injection 
samples,  and  if  survived  indicates  a  blank  sample,  the  average  number 
M_  of  units  per  sample  couldlie  eatiamted  from  the  proportion  of  survi¬ 
vors  q; 

•*»  -m 

q  =  e  j  M  =  -In  q. 

These  estimates  are  quite  easily  made.  Then  with  two  successive 
concentrations,  giving  partial  mortality;  the  ratio  of  two  estimates 


Mean  Square 

2.44 
O.  33 
O.Q3 
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of  m  in  one  test  should  approximate  the  dilution  ratio  (in  these  cases 
O*  5  log).  This  would  not  be  realized  exactly  in  any  one  comaprison, 
but  with  a  long  series  the  relation  should  appear.  Filure  of  the  M 
ratios  to  agree  with  the  dilution  ratios  is  regarded  as  evidence  against 
the  theory. 

For  illustration  a  firaly  typical  assay  of  an  encephalomyelitis  , 
preparation  by  intra-cerebral  injection  in  mice  is  taken.  Unlike  j 
Patrick's  series,  dilutions  were  a  log  apart  rather  than  half  a  log. 


g  dilution 

Response 

o/o  "" 

• . P  . 

q 

<  Estimated 

7.0 

16/16 

100,0 

1.000 

0,000 

WM  ' 

8,0 

16/16 

100.0 

1.000 

0.000 

9,0 

9/15 

60.0 

0.600 

0.400 

0.92 

10,0 

3/16 

18.  8 

0.188 

0.812 

0.  21 

From  the  first  dilution  (log  is  9.0)  showing  partial  mortality,  the 

value  of  q  is  0. 0400.  The  theory  being,  tested  would  say  that  O.  4 
proportion  of  the  injection  samples  contained  zero  particles,  Solv¬ 
ing  the  equation  q  =  e'^ith  q  taken  as  0,40,  m  comes  out  as 
-ln(q)  or  0.92.  The  second  dilution  similarly  treated  gives  as  an 
estimate  of  m,  O,  21.  The  ratio  is  0,  92/0, 21  or  about  4.  4,  This 
is  far  from  the  dilution  ratio  of  10,  to  be  expected  if  the  theory  holds. 

With  the  aid.of  Pvt.  Isen  a  large  number  of  such  ratios  from 
Patrick's  1,955  and  1956  test  were  assembled,  Logs  of  computed 
ratios,  from  teste  where  2  estimates  from  partial  mortality  were 
possible,  were  assembled  and  cr  mparod  with  the  theoretical  0.50, 


Mean  Log  Ratio 

95  o/o  Confidence 

Year 

No.  Tests  Used 

Of  Estimates  of  M 

Limits 

1955 

104 

0.33 

0. 27  -  0.  39 

1956 

166 

O.  40 

O.  33  -  0  47 

Results  do  not  bear  out  the  theory  that  a  Poisson  distribution  of 
infective  particles  will  explain  mortality  or  survival. 

To  sum  up,  experience  with  the  independent  action  model  in  all-or- 
none  teste  at  Fort  Dotrick,  has  not  been  very  encouraging.  Liipited 
tests  of  the  theoretical  basis  have  not  sustained  the  basic  theory,  ‘ 


ANALYSIS  OF  A  FUNCTION  IN  COLLABORATIVE  EXPERIMENTATION 


Walter  D.  Foster 
Biomathematics  Division 
'"  Fort  Detrick,  Frederick,  Maryland 


I.  INTRODUCTION.  The  usual  objective  in  collaborative  or  referee 
experimentation  is  to  make  comparisons  among  the  set  of  participants 
with  the  over-all  criterion  that  stations  be  no  more  diverse  than  runs 
at  a  station,  Thus,  station  means  and  variances  are  the  values  for  in¬ 
ter  station  comparison.  This  paper  is  concerned  with  the  response 
variable  for  a  particular  class  of  referee  experimentation  and  its 
analysis.  .  , 

In  this  collaborative  experiment,  each  of  five  laboratories  ran  a 
series  of  aerosol  tests  in  which  P.  tularensls  tagged  with  radioactive 
phosphorous  (p32)  Was  aerosolized  in  rotating  drums  and  sampled  at 
eight  points  in  time  over  a  22 -hour  period.  The  five  laboratories  with 
identical  equipment  achieved  the  series  of  tests  at  approximately  the 
same  time,  going  to  extreme  lengths  to  achieve  homogenous  methodology, 
Three  treatments  were  introduced  consisting  of  three  relative  humidity 
conditions  in  the  rotating  drums  of  20fo,  50$  and  80%.  Two  asrosols 
or  runs  were  completed  per  humidity  at  each  participating  laboratory 
on  a  randomized  basis.  It  is  of  interest  |to  note  that  three  separate 
nations  wore  represented  in  these  five  stations. 

"  It  was  the  objective  of  this  experimentation  to  , 

(1)  Compare  station  means, 

(2)  Compare  station  variances, 

(3)  To  identify  stations  whose  results  did  not  conform  to  those  of 
the  others, 


(4)  To  examine  the  station  by  treatment  interaction,  i.e.  ,  whether 


sii£f5.y cftCc c 
another. 


to>  weie.iiunmienc  irom  one  station  to 


II.  DEFINITION  OF  THE  RESPONSE  VARIABLE.  When  an  aerosol 
is  monitored  over  a  period  of  time,  the  measurement  usually  taken  is 
the  concentration  at  a  aeries  of  points  in  time.  Thus,  the  definition 
of  the  response  variable  to  be  analyzed  could  he  the  concentration,  . 

. ;T’  ' . .  i  • 
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given  a  particular  set:  of  sampling  times,  However,  this  concept  is 
likely  to  ignore  the  design  restriction  that  only  runs  are  random,  not 
sampling  points  in  a  rUn.  A  second  and  better  response  variable  is  the 
function  describing  concentration  and  its  change  in  time.  Such  a  function 
in  aerobiology  is  called  a  decay  function.  Previous  research  has  iden¬ 
tified  a  reasonably  simple  expression  shich  is  excellent  for  summarizing 
the  course  of  an  aerosol  in  time: 

■  "  ■  ■  VP  *  C  (t+  1)  V 

1  0 

;•  •  V  .  . 

.  i  ; 

The  usual  univariate  approach  to  the  analysis  of  a  function  such  as 
,  .the  one  given  above  would  be  to  analyze  separately  the  parameters  of 
this  function,  C0,  b,  k.  However,  not  only  are  these  parameters  known 
to  be  correlated  because  of  the  design  of  the  experiment  but  they  are 
also  known  to  be  stochastically  correlated  from  one  aerosol  run  to  another, 
Therefore,  it  is  the  purpose  bare  to  show  how  the  entire  decay  function, 
identified  as  the  response  variable,  can  be  analyzed  and  Interpreted 
through  the  usual  analysis  of  variance  technique, 

in.  analysis  or  Variance  or  the  decay  function,  with  ' 

the  deoaylunction  as  the  response  variable,  She  following  analysis  of 
variance  has  been  accorded  this  response  for  the  purpose  of  examining 
stations  levels,  variability,  and  station  by  treatment  interaction.  Tha 
complete  analysis  of  variance  is  shown  in  Table  T  in  detailed  form  where 
all  of  the  objectives  have/ been  answered.  Ita  construction  is  given  in  a 
separate  section. 


Ii: 
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TABLE  I. 

A,  V,  OF  DECAY  FUNCTION  FOR  STATIONS  AND  TREATMENTS 


Line 

Soui'ce 

dl 

MS 

15 

Mean 

3 

387, 1591 

16 

Stations 

12 

,  1737 

17 

A  vs  Rest 

3 

.5894 

18 

Among  Rest 

9 

.  035Z 

19 

Treatments 

6 

.  0409 

20 

S  x  T 

24 

.  0151 

21 

Runs  in  S  x  T 

45 

.  0195 

22 

Runs  in  20% 

15 

.  0313 

23 

Runs  in  50% 

13 

.0129 

24 

Runs  in  80% 

15 

„  .0118 

25 

Deviations 

150 

.0014 

26 

TOTAL 

The  following  brief  interpretation  is  accorded  the  analysis  of 
variance  shown  in  Table  I  in  order  to  provide  specific  answers  to  the 
objectives  of  this  experiment.  Reading  from  the  bottom  of  the  table, 
the  runs  have  been  pooled  over  stations  per  treatment  affording  a  test 
of  homogeneity  of  variance  from  one  treatment  to  another  in  lines  22-24. 
This  departure  from  the  original  objective  is  better  achieved  than  the 
original  for  estimating  station  variability  because  of  the  limited  num¬ 
ber  of  runs  per  treatment.  There  is  a  suggestion  that  the  runs  were  lees 
homogeneous  at  the  20%  humidity  than  at  the  other  two,  In  line  20,  it 
is  clear  that  the  station  by  humidity  interaction,  if  not  zero,  was  small. 
On  the  other  hand  In  line  16,  differences  among  stations  were  obviously 
large  compared  to  runs  In  S  x  T,  line  21.  The  contrast  Of  A  versus  tile 
remaining  stations,  line  17,  accounted  for  a  large  proportion  of  the 
station  variability,  with  the  variation  attributed  to  the  remaining  stations 
being  Scarcely  larger  than  the  variation  among  trials  at  a  given  station; 
The  purpoae  of  this  partition  in  line  17  was  to  investigate  whether  the 
variation  among  the  remaining  stations  haB  been  reduced  to  magnitude 
of  trial-to-trial  variation,  Further  partition  is  In  order  so  long  as  it 

could  be  helpful  in  identifying  and  possibly  eliminating  factors  at  etatlons 
causing  station  departures. 


92  ,  •  Design  of  Experiments 


This  brief  interpretation  was  developed  completely  on  the  basis  of  the 
analysis  of  variance  in  Table  I.  It  would  be  desirable  to  present  a 
tables  df  means  to  accompany  the  variance  analysis.  This  is  the  point 
at  which  multivariate  techniques  in  general  are  at  a  disadvantage,  for 
there  is  no  plainly  defined  quantity  which  is  easily  tabled.  Two  sug¬ 
gestions  are  given  here  as  a  means  by  which  the  interpretation  can  be 
visualized;  these  are  first  by  graphs  and  secondly  by  the  coefficients 
of  the  decay  function.  The  graphs  for  each  staition  are  given  in  Figure  1 
where  the  values  have  been  averaged  over  all  three  humidity  conditions. 
The  coefficients  computed  as  estimates  of  the  parameters  of  the  decay 
function  are  given  below, 


Values  of  Decay  Function  Constants 
Stations 


A 

1  B 

C 

D 

E 

Log  Cp 

2.  227 

2.  053 

1.879 

1.  868 

1.  972 

b  x  10^ 

.  .668 

.  994 

.  053 

.406 

.839 

k  x  10 3 

.264 

.  193 

.  219 

,  205 

.073 

It  is  appreciated  that  neither  of  these  means  of  visualizing  station 
differences  is  perfect;  nevertheless,  they  are  suggested  here  as  the 
best  which  are  easily  available, 

A  few  remarks  are  necessary  here  before  describing  in  the  next 
section  the  technique  for  the  analysis  of  variance  of  a  decay  function. 
The  question  of  autp-correlation  always  seems  to  appear  in  problems 
in  time  series  such  av»  these,  However,  it  is  contended  here  that  be¬ 
cause  of  the  function  approach  the  question  of  auto-correlation  of  the 
successive  does  not  arise.  Only  the  residuals  are  important.  *nd 
when  the  decay  func  tion  is  found  to  provide  an  excellent  summary  of  the 
change  of  concentration  in  time  the  residuals  may  he  considered  as 
mutually  independent,  A  second  remark  has  to  do  with  the  potential 
uBe  of  the  results  of  this  kind  of  referee  experimentation.  With  the 
variation  noted  here  and  appraised  to  be  acceptable,  these  data  afford 
a  basis  for  constructing  a  quality  control  approach  to  future  aerosol 
runs  in  which  aberrant  points,  runs,  and  even  stations  may  be  readilv 
identified.  ? 
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IV.  CONSTRUCTION  OF  THE  ANALYSIS  OF  VARIANCE  OF  A 
DECAY  FUNCTION.  On  an  individual  run  basis,  the  familiar  partition 
of  variation  is  obtained  as  shown  in  Table  II  with  the  exception  that  no 
correction  Is  shown  separately  for  the  mean  --  the  p  parameters  of 
the  decay  function  are  shown  together. 


TABLE  II. 

A.  V.  OF  DECAY  FUNCTION  FOR  A  SINGLE  RUN 


Line 

Source 

dl 

e.  g. 
df 

1 

Function 

P 

3 

2 

Deviations 

n-p 

5 

'»  3  ' 

TOTAL 

n 

8 

The  second  step  is  to  compute  the  analysis  of  variance  for  each 
station  over  the  r  runs  for  a  given  treatment  as  is  shown  in  Table  111, 
The  sum  of  squares  for  line  4  are  obtained  as  usual  where  the  function 
ii  fitted  to  the  entire  set  of  values  for  the  r  runs  and  the  computation 
is  achieved  on  a  per  item  (or  per  value)  basis,  The  sum  of  squares  for 
line  5  is  obtained  easily  merely  by  summing  the  sum  of  square*  for  line 
1  In  Table  II  for  the  various  runs  and  subtracting  line  4,  Similarly, 
line  6,  deviation*  in  runs,  is  obtained  by  summing  the  values  in  line  2 
over  all  runs, 


TABLE  111. 

A,  V,  OF  DECAY  FUNCTION  FOR  A  STATION  AND  A  TREATMENT 


Line 

Source 

df 

4 

Mean 

P 

3 

5 

Among  runs 

P(r-1) 

3 

6 

Deviations  in  runs 

r(n-p) 

10 

7 

TOTAL 

rn 

w 

95 
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A  small  digression  may  be  helpful  at  this  point  to  explain  the  degrees 
of  freedom  shown  thus  far  in  the  analysis  of  variance.  The  degrees  of 
freedom  in  line  5  are  shown  to  be  the  usual  degrees  of  freedom  for 
■  runs,  r-1,  multiplied  by  the  number  of  parameters  to  be  estimated  in 
f  the  decay  function.  Although  these  parameters  are  known  not  to  be  in¬ 
dependent,  they  continue  to  be  identified  as  restrictions  in  the  least 
squares  process  for  estimation  and  as  such  must  be  deducted  si  degrees 
of  freedom.  It  is  not  likely  that  a  further  partition  of  these  degrees 
of  freedom  could  be  achieved  in  a  manner  such  as  to  show  contrasts 
among  the  parameters  themselves. 

With  the  introduction  of  t  treatments  at  a  station,  th^e  analysis  of 
variance  aS  outlined  in  Table  IV  is  appropriate  for  each  station,  where 
the  partition  is  basically  a  nested  one.  As  before,  the  function  is  fitted 
over  all  points  in  order  to  provide  the  sum  of  squares  due- to  the  function, 
line  8,  The  sum  of  squares  for  treatments  is  obtained  through  a  two 
step  procedure.  First,  the  sums  of  squares  shown  in  line  4  of  Table  III 
for  each  treatment  are  added.  Then  the  sum  of  squares  for  the  mean  in 
line  8  is  subtracted,  the  difference  being  specifically  that  due  to  vari- ,, 
ation  among  treatments  and  is  entered  in  line  9.  The  sum  of  squares  for 
runs  in  treatments,  line  10,  is  obtained  by  summing  the  sum*  of  squares 
for  each  trial'  separately  for  that  particular  treatment,  1,  e.  ,  the  aum  of 
linea  5  for  that  station.  They  cab  also  be  listed  in  partition  as  in  lines 
11  and  12  of  Table  IV,  Similarly,  the  sum  of  squares  for  deviations 
.  are  obtained  by  pooling  for  line  13. 

" '  .  ■  .  ,  ■  ■  •  5  -  ' "  77  7 > 

...  '"TABLE  IV,  ■  ; 

A.  V.  OF  DECAY  FUNCTION  AT  STATION  A  WITH  TREATMENTS 


Line 

Source 

df 

e.g; 

df 

8 

Mean 

P 

.  ;3 

9 

Treatments 

p(t-l) 

6 

10 

Runs  in  T 

pt(r-l) 

9 

11 

in  Tx 

P(r-l) 

3 

12 

in  T2 

Pir"l) 

3 

etc 

etc 

3 

13 

Deviations 

rt(n-p) 

30'' 

14 

TNAtp  A  T 
iVWnii 

•  fern . 

48 

96 
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The  construction  of  the  over-all  analysis  of  variance  as  shown  in 
Table  I  qpntinues  to  be  based  upon  the  previous  tables  in  a  sort  of  a 
building  block  arrangement,  The  mean,  line  15,  is  obtained  by  finding 
the  aum  of  squares  due  to  the  function  when  fitted  to  all  of  the  points 
in  the  combined  collaborative  experiment.  Line  16  is  obtained  by  a  two 
step  procedure:  the  sum  of  squares  for  line  8  in  Table  IV  is  summed 
over  the  s  stations;  from  this  sum  of  lines  8  the  sum  of  squares  in 
line  15  is  subtracted,  The  difference  then  represents  the  aum  of  squares 
due  to  stations  averaged  over  treatments. 

The  partition  of  the  station  sum  of  squares  as  initiated  in  line  17 
depends  upon  which  station  appears  to  show  the  greatest  departure  from 
the  other  stations,  following  the  philosophy  given  briefly  in  the  inter¬ 
pretation  of  the  example  above.  Assuming  that  this  identification  of 
the  greatest  departure  can  be  made  from  a  study  of  the  graphs,  line  17 
then  represents  the  contrast  between  the  station  with  the  maximum  de¬ 
parture  and  the  rest  of  the  stations.  This  partition  is  accomplished  in  a 
three  step  procedure  as  follows,  The  sums  of  squares  given  in  line  8 
of  Table  IV  are  added  for  the  four  stations  marked  as  "rest".  This  sum 
is  entered  as  line  "a"  in  the  ancillary  computation  table  below.  The 
second  step  is  to  compute  the  sum  of  squares  for  the  function  whan  fitted 
to  all  the  points  represented  by  the  four  stations  combined  as  "rest!', 
having  excluded  the  station  with  the  maximum  departure  froth  the  computa¬ 
tion- -line  "b"  below.  The  third  step  is  to  subtract  the  sum  of  smarts 
in  line  "b"  from  the  sum  of  squares  in  line  "a",  giving  the  "among  rest" 
sum  of  squares  a i  shown  in  line  "e".  Finally,  the  subtraction  of  line  "c" 
aum  of  squares  from  line  16  is  entered  In  line  17  and  is  identified  as  the 
contrast  station  A  versus  "rest".  Further  orthogonal  partitioning  for 
other  "departures"  can  be  computed  in  this  fashion. 


Line 

a 

b 

c 


Ancillary  Computation  for  Table  I 
Source 

Sum  of  line  8  for  "rest"  stations 

Mean  for  "rest" 

a-b  a  among  "rest"  stations 


A  new  computation  is  required  for  line  19,  the  sum  of  squares  due  to 
treatments.  This  is  accomplished  by  considering  all  points  for  the  first 
treatment  including  those  for  the  various  stations  and  fitting  the  decay 
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function.  This  is  achieved  for  each  treatment.  These  sum  of  squares  are 
added  over  the  various  treatments.  From  this  over -all  sum,  the  value 
in  line  15  is  subtracted,  giving  the  variation  among  treatments  averaged 
over  stations. 

The  interaction  term,  station  by  treatment,  as  shown  in  line  20,  is 
obtained  in  the  usual  way.  Briefly,  it  consists  of  summing  line  4  over 
all  stations  and  treatments.  From  this  sum  are  subtracted  lines  15,  16 
and  19. 

■  . ,  .  ' .  .  !  ■■  ■  ■■  ;; 

Line  21  is  obtained  easily  by  summing  all  lines  in  Table  HI.  The 
partition  of  line  21  as  shown  in  lines  22  and  23  is  eiilly  accomplished 
according  to  the  purpose  at  hand  merely  by  restricting  tho  summing  to  the 
category  desired.  • 

Missing  values  will  complicate  this  analysis  and  Indeed  will  render  the 
partition  non-orthogonal  if  missing  values  are  not  restored  to  the  analysis. 
Therefore,  it  is  recommended  that  a  simple  procedure  for  estimating  these 
miesing  values  Such  as  computing  the  value  according  to  the  function  li» 
estimated  from  the  remainder  of  the  points  bslhg  inserted  with  one  degree 
of  freedom  per  missing  value  being  subtracted  from  the  degree  of  freedom 
assigned  to  deviations,  Mote  that  in  the  simpler  analyses  which  are  com¬ 
pletely  nested  orthogonality  does  not“,depertd  upon  equal  numbers. 
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Recently  two  entomological  field  experiments  were  conducted  at  Dug- 
way  Proving  Ground.  The  purpose  of  the  first  experiment  was  to  com¬ 
pare  the  biting  propensity  of  two  strains  of  a  species  of  insect.  In  each 
trial,  four  15-foot  radius  circles  were  scribed,  and  10  hosts,  randomly 
selected,  were  positioned  e&ii distantly  along  each  circumference,  The 
Number  1  position  in  each  circle  was  oriented  to  true  norih,  (See  Figure 
1. )  At  function  time,  100  individuals  of  the  appropriate  strain  were  re¬ 
leased  at  the  center  of  each  circle,  In  two  of  the  circles,  the  A  strain 
was  used)  in  the  other  two  circles,  the  B  strain.  The  men  were  seated 
on  the  ground  and  remained  relatively  motionless  throughout  the  trial. 

|  Sampling  consisted  of  each  man  recording  those  bites  actually  received 
and  entering  the  total  number,  for  5-minute  intervals,  on  a  data  card. 
Sampling  was  conducted  for  30  minutes  following  the  release  unless  biting 
activity  continued,  in  Chat  event,  sampling  in  all  circles  was  extended  for 
additional  5 -minute  periods  until  the  biting  activity  had  essentially  ceased, 

Comparisons  between  strains  were  thus  subject, to  the  variation  found 
among  circles.  This  variation  was  expected  to  b«  appreciably  larger 
than  the  variation  among  men  on  a  circle.  By  the  nature  of  the  experi¬ 
mental  treatments  (strains),  however,  it  was  necessary  to  separate  the 
strains  either  in  space  or  in  time  sufficiently  that  their  ranges  of  biting 
activity  did  not  overlap.  Only  in  this  manner  could  bites  be  accurately 
attributed  to  one  strain  or  the  other.  The  duplicate  circles  for  each 
strain  represented  an  effort  to  partially  overcome  this  inherent  insen¬ 
sitivity.  ■ 

In  thp  nnn lyni  a  nf  the  data,  it  js  considered,  useful  to  employ  a 
mathematical  model  to  describe  the  distribution  of  the  number  of  biteB 
per  host,  The  simplest  model  which  might  conceivably  fit  the  obser¬ 
vations  is  the  Poisson,  given  by: 

(1)  f(x)  p  e"m  mx/x!  x  ■■  0,  1 . n, 


«Smt3liG? 


—  U>o*l  battery  field  telephone  line i  □  telephone 
O  On-eite  neteorologioel  aenaing  etetlon 
Q  Boxed  recording  inatrumenta 
X  Teat  fixture 
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where  x  is  the  number  of  bites  received  by  an  individual  host,  f(x)  is 
the  probability  (or  relative  frequency)  of  x  bites,  and  m  is  an  un¬ 
known  parameter  equal  to  the  "long-run"  average  number  of  bites  per 
host.  If  the  individuals  of  a  strain  are  randomly  distributed  throughout 
a  given  area,  and  it  hosts  are  equally  attractive,  then  the  Poisson  model 
should  be  appropriate, 

Previous  studies,  however,  have  indicated  that  the  spatial  distribution 
of  insects  released  in  this  manner  is  not  random  (perhaps  being  influ¬ 
enced  by  the  wind  direction,  for  example),  nor  are  all  hosts  equally 
attractive,  As  a  result  of  these  tendencies,  the  distribution  of  bites  will 
be  "over-dispersed"  relative  to  the  Poisson  distribution,  i.  e.  ,  the  num¬ 
ber  of  hosts  receiving  a  very  large  number  of  bites  and  the  number  of 
hosts  receiving  a  very  small  number  of  bites  will  both  be  larger  than  the 
number  predicted  b^r  the  Poisson  model,  while  the  number  receiving  near- 
average  numbers  of  bites  will  be  smaller. 

One  of  the  simplest  and  most  frequently  used  ''-over-dispersed" 
statistical  models  is  the  negative  binomial,  which  has  the  general  term: 


(2)  f(x)  « 


+  X-UI 

(k-l)f 


-P_ 

q 


x  =  0,  1,  2, 


n, 


where  q  equal*  l  +  p,  and  p  and  k  are  unknown  parameters,  Various 
rationales  may  be  given  for  the  negative  binomial.  *  One  of  the  simplest 
is  that  the  negative  binomial  la  produced  by  a  mixture  pf  Poisson  dis¬ 
tributions  in  which  the  parameter,  m,  varies  according  to  a  "gamma" 
distribution.  While  no  rationale  appears  to  be  particularly  compelling 
In  the  present  problem,  the  relative  simplicity  of  the  negative  binomial 
model  And  the  success  with  which  other  investigators  have  applied  it  to 
biological  data  are  taken  to  justify  its  use,  at  least  as  a  working  hypothe¬ 
sis* 


aa^H  ft  -mir.uto  iitn.6  pi?iod,  ths  vv%  *  a  virisiici  of  ths  r^po  rtsd 

bites  at  each  circle  were  estimated.  Each  set  of  data  was  then  tested 
for  over -dispersion  with  respect  to  a  Poisson  distribution  by  the  ')C2 
statistic: 


^Bliss,  C.  F,  Fitting  the  Negative  Binomial  Distribution  to  Biological 
Data,  Biometrics,  Vpl.,9..  (21  pp.  176-196,. _ ^  ; _ 
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X2  1  "  (n-ljs2  /  X, 


"2 

where  n  is  the  sample  size  (number  of  hosts,  s  is  the  sample  variance 

2 

of  the  number  of  bites,  and  3  is  the  sample  mean  number  of  bites. 

The  calculated  statistic  was  tested  for  significance  by  comparison  with 

the  20  per  cent  upper  tail  value  of  the  X4  distribution.  If  the  test  did 
not  indicate  over-dispersion,  the  data  were  subsequently  fitted  to  a 
Poisson  distribution  and  subjected  to  a  "goodness-of-fit"  tost.  If 
the  test  did  indicate  over-dispersion,  the  data  were  fitted  by  the  method  f 
of  maximum  likelihood^  to  a  negative  binomial  distribution,  and  then  sub¬ 
jected  to  a  goodness -of- fit  test.  All  of  the  above  calculations  were 

performed  on  the  IBM  1620  Computer,  using  a  specially'  prepared  FORTRAN 
program.  Fifty-five  of  96  sets  of  5-minute  data  showed  close  agreement 
with  the  Poisson  distribution.  For  each  of  these  sets  of  data,  however, 
the  variance  was  usually  larger  than  the  mean,  and,  consequently,  a  fur¬ 
ther  comparison  with  the  negative  binomial  distribution  would  gene  rally 
have  shown  even  closer  agreement.  ®  Therefore,  It  was  decidedthat, 
for  the  purposes  of  the  analysis  of  variance,  an  appropriate  transformat¬ 
ion  to  stabilize  variance  for  these  data  would  be  that  derived  for  the 

6  7'  1 

negative  binomial;' 

ilbld. 


3  For  confenl  ence  of  internal  calculation  on  a  digital  computer,  the  20  per 
cent  upper  tail  X2  value  was  obtained  from  the  approximation; 


2 

log#2i— 1  .1  .  -O,  038  -  0.452  log  (n-1) 
n-1  ® 

^Fisher,  R.  A.  Notes  on  the  Efficient  Fitting  of  the  Negative  Binomial. 
Biometrics,  Vol,  9(2),  pp,  196-200,  1953, 

- Th »  Pni r Rn-  in  in  .  limiting  case  of  the  negative  bincmifi,  from 

which  it  follows  that  a  negative  binomial  must  £Lt  data  at  least  as  well  as 
the  Poisson. 


I; 


6 

^Bartlett,  M.  S,  The  Use  of  Transformations,  Biometrics,  March  1947, 
Vol.  3(1)  pp.  39-52.  )i 


v 

'Kempthorne,  C.  ,  Design  and  Analysis  of  Experiments,  Chapters.  John 
Wiley  and  Sons,  Inc.  ,  1952.  X  . 
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(4)  y  ~  TC*  sinh'1  (  xVx  +  1/2). 

Figure  2,  showing  a  plot  of  mean  vereua  variance  oil  log -log  paper, 
illustrates  the  closer  agreement  with  the  negative  binomial  distribution. 
The  diagonal  line  represents  the  square  root  transformation,  appropri¬ 
ate  ferv  variance  stabilisation,  of  Poisson  distributed  data,  and  the  curved 
line  represents  the  transformation  X"1  sinh'*  (\‘\/x+  1/2),  where  K 
has  the  value  1,0,  (After  several  guesses  of  X. ,  the  value  of  1,  0  was 
selected  sine*;,  by  eye-fitting,  it  appeared  to  reasonably  minimise  the 
deviations  from  the  curve,  Using  the  value  X,  »  1.  0,  47  of  the  data 
point*  lie  above  the  Curve,  and  49  below.)  Subsequent  analysis  of  the 
data  of  Experiment  1  using  a  method  of  Bliss  and  Owen8  for  the  esti¬ 
mation  of  a  common  k,  resulted  in  the  estimate 

k  *  0. 51,  ■  .  .  , .  •• 

.  c  ...  ...  v... 

Since  \z  m  (1/k),  the  value  of  A,  appropriate  for  this  estimate  of  k  is 

'  .  -o.s  •• 

X  ■  k  «  1,4,  •  , 

■C  -  • 

As  shown  in  Figure  2,  the  value  of  A  "1,0  obtained  graphically  agrees 
reasonably  well  with  that  estimated  by  the  method  of  Bliss  and  Owen,  It 
can  easily  be  seen  in  Figure  2  that  the  data  follow  more  closely  to  the 
Curved  line,  However,  the  dashed  line  indicates  that  the  logarithmic 
transformation  may  be  as  suitable  as  the  inverse  hyperbolic  sine,'  - 
Furthermore,  analysis  of  logarithmically  transformed  data  permits  in¬ 
terpretations  of  results,  in  terms  of  ratios  of  treatment  effects,  while 
no  such  Interpretation  arises  directly  from  the  negative  binomial  trans¬ 
formation,  Therefore,  separate  analyses  of  variance  were  performed) 
using  the  two  transformations. 

An  analysis  bf  variance,  based  on  the  three-way  cross  classification 
of  trial,  strain,  and  time  period,  was  performed  on  each  of  the  following 
four  set  i  of  data: 

«k  *“<L  ■  l  j  "  " 1  ”7.” 

1.  The  values  of  y  =  A-  sinh  (X  "y  x  +1/2),  where  A,  equals  1,  0 
and  x  is  the  total  number  of  bites  received  by  a  host  during  a  given  time 
period, 


8BliBB,  C.  I;  and  A.  R.  G,  Owen,  "Negative  Binomial  Distributions  With 
a  Common  K".  Biometrika  45,  do.  37-58.  1958. 
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2.  The  values  of  y  =  A"*  sinh-^  ( \  V x  +  1/2),  where  A.  equals  1.0 
and  x  is  the  total  number  of  bitea  received  at  a  circle  during  a  given 
time  period, 


3.  The  values  of  y  =  log  (x  +  1),  where  x  is  the  .total  number  of 
bites  received  by  a  host  during  a  given  time  period,  and 

I ,  ..  ■  ’■■■  ■-  _  . . 

4.  The  values  of  y  *  log  (x  +  1),  where  x  is  the  total  number  of 
bite*  received  at  a  circle  during  a  given  time  period. 

The  results  of  each  of  these  analyses  are  presented  in  Table  1. 

•  .  "  ;  ..  ••  -  .  •  .  ii  il"  ~  • 

As  shown  in  Table  1,  the  results  obtained  in  the  four  analyses  of 
variance  were  essentially  the  same.  Each  analysis  indicated  that  the 
total  numbers  of  bites  obtained  during  the  six1  times  periods  were  signi¬ 
ficantly  different,  and  that  no  significant  difference  could  be  detected  be¬ 
tween  strains.  In  every  analysis,  however,  Error  (a)  was  relatively 
large,  so  that  the  F  test,  comparing  strain  effects,  was  undoubtedly  in¬ 
sensitive.  As  mentioned  earlier,  the  insensitivity  of  the  analyses  for 
strain  differences  follows  unavoidably  from  the  design  of  these  trials,  in 
which  strain  comparisons  could  only  be  made  between  circle*  (rather  than 
within  circles),  and,  hence,  are  subject  to  the  greater  variability  found 
from  circle  to  circle  as  measured  by  Error  (a). 

Th«  purpose  of  the  second  experiment  was  to  compare  the  dispersal 
of  two  strains  of  a  species  of  insect  as  measured  by  their  biting  activity, 

For  this  experiments  ■■it  was  greatly  desired  that  the  ambient  air  v."' 
temperature  and  vidndapeed  range  of  an  A-B  strain  pair  bf  trials' be  as 
similar  as  possible,  However,  because  of  the  small  number  of  men 
available  concurrent  testing  of  the  two  strains  could  not  be  accomplished. 
Therefore,  whenever  possible,  two  trials  were  conducted  each  day- -one 
trial  using  the  A  strain  and  the  other,  following  as  soon  after  as  practi¬ 
cable,  employing  the  B  strain. 

In  each  trial,  four  concentric  circles  were  used,  designated  Circle  a 
A,  B,  C,  and  D  With  radii  equal  to  100,  200,  300  and  400  feet.  Eight 
men  were  positioned  equidistantly  around  each  circumference  of  Circles 
A,  Bi  and  D,  and  16  men  were  positioned  equidistantly  around  the  circum¬ 
ference  of  Circle  C. .?  (See  Figure  3. )  At  function  time,  1000  individuals 
of  the  appropriate  strain  were  released  at  the  center  of  the  concentric 
configuration,:  and  the  men,  seated  and  facing  the  release  point,  recorded 

:  V" : -f  ■■'■■  ■  '  . ~  ■’  . r  " ■  V  « 

;i 

•  ‘  il 
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biting  activity  for  at  least  30  minutes.  The  sampling  proceedures  were 
the  same  as  those  used  for  the  first  experiment. 

For  each  5-minute  time  period,  the  mean  and  variance  of  the  reported 
bites  at  each  circle  wera  estimated,  Each  set  of  data  was  then  tested  for 
0 over -dispersion!'  with  respect  to  a  Poisson  distribution  in  the  sanme  planner 
E  as  in  the  first  experiment. 

1 

The  results  indicated  that  there  was  nearly  always  a  departure  from 
the  Poisson  distribution,  in  the  direction  of  higher  variance  and  "over- 
dispersion,  "  In  addition,  45  of  the  70  eete  of  5 -minute  data  showed 
agreement  with  the  negative  binomial  distribution  at  a  nomial  95  per  cent 
confidence  level,  Further,  from  an  examination  of  the  plot  of  the  mean 
versus  the  variance  (see  Figure  4),  it  did  not  appear  that  the  data  would 
fit  any  other  distribution  more  consistently,  Therefore,  it  was  decided 
|  that,  for  the  purposes  of  the  analysis  of  variance,  a  suitable  transfer  - 

I  mation  to  normalise  these  data  would  be:  ,, 

*  , . .  .  ■  ■ ■ 

y  »  X  1  ■inh-1  (XV  ji  +  l/Z), 

t.  ' ,  ■  .■ .  ■  v-  (  ,  s.  ■  .  : 

After  several  guesses  of  A,  and,  subsequently,  fitting  the  data  by  eye 
to  eihh"^  (X'V  x  +  l/Z),  it  appeared  that  a  reasonable  estimate  that 

would  minimise  the  deviation!  from  the  Curve  was  A  -  1,  0.  Using  this 
value,  42  of  the  data  points  lie  above  the  curve,  and  43  below. 

An  analysis  of  variance,  based  on  the  four-way  cross  classification 
of  day,  strain,  circle,  and  time  period,  was  performed  on  each  of  the 
j  following  seta  of  data!  • 

j  1.  The  values  of  y  *  ”X  "^sinh"1  (?\V  *  +  1/2)  where  ft  ■  1.  0,  and  x 

is  the  total  number  of  bites  received  during  a  given  time  period  at  Circles 
j  Ai  B,  and  D,  and  one -half  the  total  received  at  Circle  C, 

■  :  The  results  of  these  analyses  are  presented  in  Table  2.  " 
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Table  2:  Results  of  the  Analyses  of  Variance  of  Transformed  Bite  Data 


RESULTS  OF  ANALYSIS  OF  VARIANCE  FOR 
INDICATED  TRANSFORMED  DATA* 


SOURCE  DEGREES 

OF  OF  Mean 

VARIATION  FREEDOM  Square 

Day7T>  '  r  0. 342065 
Strain,  S  1  0,265038 

Error  (a)  1  0,271097 

Circle,  C  3  1.020387 

C  x  S  3  0. 044502 

Time  Period,  T,  9  0.  670518 

T  xS  9  0.115  344 

TxC  ,  27  6.044332 

TxCxS  27  0.  011870 

Error  (b)  78  0.020225 


F 

Value 


50. 5  ** 
2.  20 
33.2  ** 
5,  70** 
2. 19** 
0.587 


Mean 

Square 

0.  33  1695 
0.241103, 
0. 225376 
1.199593 
0.  044751 
0.  623410 
0. 108279 
0. 043864 
0. 014230 
0.  01 6677 


F 

Value 


71.9  ** 
2.  68 
37.4  ** 
6.  49** 
2, 63** 
0.  853 


Total 


*1  denote*  the  data  resulting  from  the  ■inh"i  (TCV*  +  1/2)  transfer  - 

mation  of  total  bitee  received  at  a  circle  during  a  givnHtlme  pirlodi  and  2 
denote «  the  data  resulting  from  the  slnh”"  (7^  x  +  1/2)  transformation 
of  total  bites  received  during  a  given  time  period  for  Circles  A,  B,  end  D , 
and  one-half  the  total  bites  received  at  Circle  C. 

**  Significant  at  the  1.0  per  cent  level, 

A  a  shown  by  the  F  values  in  Table  2,  the  second  analysis,  adjusting 
for  the  augmented  sampling  on  Circle  C,  was  the  more  sensitive.  Both 
analyses,  however,  showed  circle,  time  period,  T  X  S,  and  T  x  C  to  be 
highly  significant. 

Using  the  second  set  of  transformed  data,  a  further  investigation  of 
circle,  T  x  S,  and  TxC  was  made  in  the  following  way.  From  the 
analysis  of  the  transformed  values: 
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(5)  yjjk  B  A.'1  sinh"1  (XV xijk  +  1/2)  ,  A  =  1.0 


=  sinh"  -\/xijk  +  1/2, 


where  x^k  equals  the  total  number  of  bites  received  by  the  i-th  host  at 

the  j-th  circle  during  the  k-th  time  period.  The  mean  values,  Yjk,  of 

the  transformed  variables  were  obtained.  These  mean  Values  are  related 
to  the  estimated  true  average  number  of  bites  received  at  the  j-th  circle 
during  the  k-th  time  period,  A<k,  by 


(6)  y^k  ■  sinh  -y  +  1/2,  hence 
mjk  ■  (sinh  y.J2  -  1/2. 


Relationships  between  y,.  and  circle  radius  R.,  were  sought.  The  best 

..  J  '  V- 

simple  relationship  found  was: 

IT)  Yjk  ■  *  -  b  lhgBRj,  „  , 

where  a  and  b  are  regression  constants  determined  by  the  method  of 

least  squares, 


(8)  Then ,  •  ,  , 

tn^k  =  j^sinh  (a  -  b  log^Rjjj  -  1/2, 

r  a  .k  i««  i».  .«*¥  lo2_S:  i  o 

(SI  .  -•  J)J  -  1/2, 

(10)  -  [l/2(.Vb  K?J  ..-.b  l08«  RJ|]  2  .  1/2 


116 

(11)  *[l/2(eaR  "b  -e  &Rj  )]  2  -  1(1, 

which  can  be  approximated  by: 


(12) 


A 

m 


2a 


jfc 


TS  -  1/2, 


since  e  )  la  email  relative  to 
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For  each  5 -minute  time  period,  tile  transformed  data  were  summed  with-, 
respect  to  circle  and  strain.  These  values  were  then  fitted  to  the  above 
regression  model,  and  the  average  values  of  the  various  a's  and  b1  s 
determined,  Subsequently,  for  each  strain,  the  true  average  number  of 
bites  was  estimated  for  each  circle  during  the  varioue  time  periods.  These 
latter  values  are  presented  in  Table  3. 
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Table  3:  Estimated  True  Average  Humber  of  Bites  of  A  and  B  Strain  at 
the  Various  Circles  During  Given  Time  Periods. 


ESTIMATED  TRUE  AVERAGE  NUMBER  OF  BITES  AT 
TIME  INDICATED  CIRCLE  DURING  GIVEN  TIME  PERIOD 
STRAIN  PERIOD  Circle  A  Circle  B  Circle  C  Circle  D 

(Minutes)  (IQO  feet)  (200  feet)  (300  feet)  (400  feet) 


0-  5 

123 

15 

4 

1 

5-10 

.7 

145 

26 

1.0 

5 

10-15 

119 

28 

'  .  ;  i„  12 

7 

15-20 

120 

29 

12. 

7 

20  -  25 

82 

20 

8 

4 

25-30 

39 

15 

8 

5 

30-35 

22 

10 

6 

4 

35-40 

1 6  ,  ij 

8 

5 

4 

40-43 

8  ■/-; ' 

6 

■  '  5 

4 

45-50 

6 

4 

.  4 

3 

0-  5 

99 

25 

11 

6 

5-10 

132 

35 

16 

9 

10-15 

99 

32 

.  16 

10 

15-20 

59 

21 

12 

8 

,20-25 

39 

19 

13 

10 

25-30 

19 

9 

S’ 

4 

30-35 

9 

6 

5 

4 

35-40 

.  2 

2 

2 

2 

40-45 

4 

2 

1 

1 

45-50 

0  , 

0 

0 

0 

/V| 

it- 


As  shown  in  Table  3,  the  expected  number  of  A  strain  bites  at  Circle  A 
during  each  of  the  various  time  periods  is  greater  than  that  for  B  strain! 
however,  the  difference,  in  general,  is  not  »ppr«ri»hlj»  At  Circles  B,  C, 
and  D,  there  appears  to  be  no  important  difference  between  the  number  of 
bites.  It  was,  therefore,  concluded  that  the  spatial  dispersion  of  the  two 
strains  was  comparable,  as  indicated  by  the  non  significance  of  the  C  x  £ 
interaction. 
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The  significance  of  the  T  x  S  interaction  indicates  a  difference  be¬ 
tween  strains  with  respect  to  the  temporal  dispersion  characteristics. 
Generally  speaking;  the  biting  activity  of  strain  B  appeared  to  exhibit 
a  more  pronounced  peak  in  time  and  a  slightly  earlier  decline. 

Unfortunately i  no  satisfactory  model  for  the  characterisation  of  the 
biting  activity  as  a  function  of  time  has  been  found  by  the  authors.  It  is 
hoped  that  such  a  model  may  yet  be  developed. 


COMPARISON  OF  APPROACHES  TO  OBTAINING  A  TRANSFORMATION 
MATRIX  EFFECTING  A  FIT  TO  A  FACTOR  SOLUTION 
OBTAINED  IN  A  DIFFERENT  SAMPLE,, 

Cecil  D.  Johnson  i! 

U.  S,  Army  Personnel  Research  Office 

BACKGROUND.  The  importance  of  physical  proficiency  measures 
to  the  selection  and  evaluation  of  Army  personnel  can  scarcely  be  questioned 
Examination  of  the  duty  assignments  prevalent  in  various  Army  jobs  indi¬ 
cates  clearly  that  physical  strength,  endurance  and  coordination  are  often 
highly  important  factors  in  job  success.  At  the  United  States  Military 
Academy  in  particular,  considerable  attention  has  been  devoted  to  physical 
training  and  to  the  measurement  of  various  aspects  of  physical  abilities  or 
physical  proficiency  among  cadctif  at  West  Point.  Various  tents  of  physical 
proficiency  were  introduced  in  the  physical  aptitude  entrance  examination 
procedure  or  studied  i’or  possible  use..  They  have  been  examined  both  as 
individual  measures  and  as  component  parts  of  various  batteries.  Several 
factor  analyses  of  large  batteries  of  physical  proficiency  measures,  physi¬ 
cal  education,  grades,  and  other  variables  were  accomplished  in  previous 
studies.  These  studies  had  as  their  objective  the  Identification  of  basic 
underlying  physical  ability  variables  that  possess  the  simplifying  statis¬ 
tical  characteristics  frequently  referred  to  as  simple  structure)  These 
basic  variables,  or  factors,  aid  in  understanding  the  nature  of  the  scores, 
in  eliminating  duplicating  measures,  and  in  suggesting  new  tests. 

The  several  factor  solutions  available  for  comparison  contain  numerous 
variables  in  common,  other  similar  variables  (as  when  a  25-yard  dash  is 
substituted  for  a  30 -yard  dash),  and  still  other  variables  which  are  unique 
for  a  particular  solution.  This  paper  considers  several  methods  for  com¬ 
paring  solutions  obtained  in  thebe  separate  studies  involving  physical  pro¬ 
ficiency  and  related  measures. 

The  problem  of  approximating  in  a  second  sample,  a  rotated  factor 
solution  originally  obtained  in  a  previously  analysed  sample  is  also  present 
in  another  Army  Personnel  Research  Office  research  study  currently  In  the 
final  computing  phase.  This  study  involved  thirty-one  psychological  tests, 
Some  of  these  tests  are  measures  of  intellectual  ability,  others  are  meas¬ 
ures  of  cognitive  information,  and  others  are  non -cognitive  measures  in 
the  "personality"  domain,  As  is  typical  with  Personnel  Research  Office 
factefb  analysis  studies,  the  objective  was  the  identification  of  constructs 
which  would  predict  the  performance  of  Soldiers  on  the  job.  In  this  case  the 
job  was  that  of  an  enlisted  Infantryman  anO  the  measure  of  performance  was 
obtained  from  ratings  by  superiors  and  peers  at  the  close  of  maneuvers  in 
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Germany,  The  tests  had  been  administered  to  the  enlisted  men  on  their 
entry  into  the  Army, 

An  initial  principal  component  factor  solution  was  transformed  by  an 
orthogonal  matrix  so  as  to  provide  simple  .structure.  The  initial  factor 
solution  can  be  described  as  a  matrix  whose  elements  are  the  correlations 
between  the  tests  and  standard  length  orthogonal  reference  vectors.  This 
solution  usually  provides  parsimony  in  that  a  relatively  email  number  of 
reference  vectors  is  needed  to  closely  approximate  the  test  correlation 
matrix  when, the  factor  matrix  is  post -multiplied  by  its  transpose.  How¬ 
ever,  the  psychologist  wants  the  reference  vectors,  or  factors,  to  have 
additional  properties  implied  by  the  concept  of  a  simple  structure,  If 
simple  structure  is  present  among  the  reference  vectors,  each  reference 
vector  has  high  correlations  with  a  few  testa  and  approximately  aero 
correlations  with  the  remainder,  Furthermore,  the  tests  with  which  a 
particular  reference  factor  has  a  high  relationship  will  be  relatively  in¬ 
dependent  of  the  other  reference  vectors.  It  Is  apparent  that  the  presence 
of  simple  structure  permits  the  psychologist  to  interpret  the  reference 
vectors  in  terms  of  his  teat,  and  if  the  orthogonality  of  the  reference 
vectors  is  retained,  as  when  the  transformation  matrix  is  orthogonal,  all 
the  original  parsimony  of  the  initial  principal  component  factor  solution 
is  retained,  Psychologists  usually  refer  to  the  process  of  transforming 
a  solution  to  simple  structure  as  rotation,  and  call  the  transformed  solution 
a  “rotated"  solution, 

In  the  factor  analysis  of  psychological  tests  described  above,  the  ro¬ 
tated  solution,  when  extended  to  the  rating  variables,  displayed  a  very  in¬ 
teresting  relationship  between  the  rotated  factors  and  the  performance 
measures,  One  cognitive  factor  and  one  nbn-cognitive  factor  predicted 
performance  while  all  other  factors  had  a  zero  relationship  with  perfor¬ 
mance.  It  became  a  matter  of  considerable  interest  to  determine  whether 
these  relationships  could  be  verified  in  an  independent  sample  Whefe  pro¬ 
perties  of  the  sample  had  not  been  used  to  determine  the  particular  trans¬ 
formation  used  to  obtain  the  rotated  factor  solution.  Both  factors  re¬ 
tained  their  validit'jr  in  the  cross  (independent)  sample,  but  an  additional 

r-  .  /  *  -'1  »  ♦*  .  It-,  ..  ,  i '  1 J  Jii... 
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In  this  study  the  factor  validities  in  the  first  sample  were  fairly  well  repli¬ 
cated  in  the  second  sample. 

Thus,  both  studies,  the  one  involving  physical  proficiency  variables 
and  the  one  involving  psychological  tests,  require  an  initial  factor  Solution 
in  a  second  independent  sample,  the  transformation  of  this  solution  tb  one 
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approximating  the  rotated  solution  in  the  first  sample,  and  finally,  the 
extension*  of  the  transformed  solution  to  non-overlapping  predictor  vari¬ 
ables  and/or  criterion  variables.  The  criterion  variables  may  well  over¬ 
lap  across  the  two  studies  but  should  be  withheld  from  the  initial  factor 
analysis  for  two  reasons; 

(1)  It  is  desirable  that  the  factors  be  entirely  defined  by  predictor 
variables, 


(2)  The  validity  of  the  transformed  factors  ar£  being  determined  in 
fh«  independent,  or  cross  sample.  Thus,  the  definition  of  the  factors  in 
the  cross  sample  must  be  independent  of  the  criterion  variables, 

B,  F.  Green  has  reported  a  method  for  computing  an  orthogonal 
transformation  matrix  which  will  minimise  the  sum  of  squares  of  the 
differences  between  the  transformed  matrix  and  the  matrix  to  be  fitted, 
However,  hie  derivation  does  not  general!**  so  as  to  provide  an  ortho¬ 
normal  transformation  that  can  utilise  more  reference  vectore  in  the  cross 
sample  than  are  in  the  matrix  to  be  fitted.  . 


If  the  investigator  is  confident  that  the  initial  croee  sample  factor 
solution  does  not  have  a  rank  which  exceeds  the  rank  of  the  solution  to 
be  fitted,  this  orthogonal  transformation  is  clearly  suitable.  On  the  other 
hand  if  in.  the  cross  sample  there  is  likely  to  be  considerable  variance 
common  to  two  or  three  variables  that  is  not  explained  fey  the  more  general 
common  factors  utilised  in  the  initial  sample,  the  advantages  of  an  ortho - 
normal  solution  become  apparent,  '  lt  : 

APPROACH  AND  RESULTS,  Thus,  in  obtaining  the  transformation 
matrix  necessary  for  fitting  K  factors,  the  investigator  has  a  choice  of 
using  a  method  which  obtains  the  best  orthogonal  transformation  matrix 
applicable  to  the  first  K  factors,  or  he  can  choose  to  use  ^.non-square 
orthonormal  transformation  matrix  which  can  be  applied  to  a  full  factori¬ 
sation,  i.  e.  ,  to  as  many  factors  at  there  are  variables.  The  first  method, 
uiing  an  orthogonal  transformation,  requires  the  fitted  solution  to  reproduce 


* 

This  factor  extension  is  accomplished  by  post  multiplying  the  m  x  n 
matrix  of  correlation  coefficients  (between  the  overlapping  and  non- 
overlapping)  by  A  D'l/2  ,  where  R  ia  the  matrix  of  correlation  co¬ 


efficients  among  the  n  overlapping  variables  and  A'  R  A 

_!  y  y  y 

A’  =  A  ■  D  =  eigen  values. 
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the  cross  sample  correlation  matrix  to  the  full  extent  possible  with  a 
principal  component  solution.  The  second  method,  using  an  orthonormal 
transformation,  provides  a  less  exact  reproduction  of  the  correlation 
matrix,  but  permits  a  better  fit  to  the  reference  factors  if  the  dimen¬ 
sionality  of  the  experimental  variable  space  exceeds  the  number  of  factors. 

Since  in  the  physical  proficiency  study  the  number  of  common  variables, 
for  some  of  the  comparisons,  was  large  as  compared  to  the  number  of 
factors  being  fitted,  and  the  initial  solutions  had  been  obtained  using  a  corre¬ 
lation  matrix  involving  even  more  variables,  the  non- square,  orthonormal 
transformation  was  utilized,  A  description  of  this  technique  is  provided  in 
the  hand-out, 

The  three  rotated  factor  solutions  to  which  the  initial  solutions  in  the 
cross-samples  were  fitted,  tended  to  have  smaller  communalities  than  the 
four  cross-sample  fitted  solutions,  This  is  possibly  explained  by  two 
things,  The  methods  of  obtaining  the  initial  solutions  (that  were  subse¬ 
quently  rotated  in  the  reference  samples)  were  less  efficient  that  the  prin¬ 
ciple  component  method  used  for  the  initial  cros«  sample  Solutions.  Also, 
the  initial  factor  solutions  in  the  first  sample  were  obtained  to  span  the 
non-common  variables  as  well,  whereas  the  cross  sample  solutions  were 
obtained  on  the  common  variables  only, 


In  comparing  the  use  of  the  orthonormal  a*  compared  to  an  ortho- 
gonaljtr&naformation,  it  becomes  a  trade  off  between  the  better. fit  to  the 
inter -correlation  matrix  obtained  by  using  an  orthogonal  transformation 
and  the.  better  fit  to  the  rotated  factor  solution  possible  under  certain  cir¬ 
cumstances  with  the  orthonormal  transformation.  The  differences  between 
the  two  methods  in  regard  to  fitting  the.  rotated  factor  tend  to  diminish  as 
the  number  of  factors  involved  increases,  On  the  other  hand,  the  advan¬ 
tage  possessed  by  the  orthogonally  transformed  solution  in  reproduqing 
the  inter-correlation  matrix  Increases,  Thus  it  is  clear  that  the  value 
of  the  orthonormal  transformation  as  compared  to  the  orthogonal  trans¬ 
formation  is  least  likely  when  the  number  of  factors  in  the  initial  rotated 
solution  is  large,  However,  the  number  and  nature  of  the  non-overlapping 

vttnauxcQ  in  tnc  lwj  dIuvubd  lo  «ieO  important. 


Since  the  extension  of  the  transformed  solution  to  the  non-common 
variables  is  an  important  aspect  of  these  studies,  the  reproduction  of  the 
intercorrelations  between  the  extended  factors  and  these  additional  vari¬ 
ables  is  an  important  consideration.  -- 
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It  is  interesting  that  the  advantage  of  the  orthogonally  transformed 
solution  for  reproducing  the  intercor relation  matrix  did  not  always  hold 
among  the  non-overlapping  variables.  This  underlines  the  fact  that  the 
advantage  of  the  orthogonal  transformation  matfrix  in  reproducing  the  cor¬ 
relation  matrix  in  the  cross  sample  is  partly  due  to  its  more  efficient 
capitalization  on  sampling  error.  This  sampling  error  effect  is  further 
underlined  by  the  fact  that  for  the  orthonormal  transformed  solution,  for 
one  sample,  the  elements  of  the  residual  matrix  involving  the  non-common 
variables  were  smaller  than  the  elements  of  the  corresponding  matrix 
involving  the  common  variables.  This  was,  of  bourse,  just  the  opposite 
of  the  results  obtained  from  the  orthogonally  transformed  factor  solution. 
However,  while  the  initial  unrotated  solution,  extended  to  the  non-common 
variables,  necessarily  possesses  the  maximization  properties  of  the  ini¬ 
tial  principal  component  solution  for  only  the  common  variables,  the  ad¬ 
vantage,  while  reduced,  was  still  present  lor  non-common  variables  in 
the  larger  samples. 

The  two  following  questions  were  raised  at  the  conclusion  of  the  two 
USAPRO  presentations; 

(1)  Have  factors  (i.  e. ,  factor  pure  tests)  proved  to  bo  good  predictors 
of  Army  performance  criteria?  , 

(2)  What  is  the  advantage,  for  prediction,  of  u^(lng  orthogonal  pre¬ 
dictors  over  the  original  correlated  predictors  if  optimal  weights  are 
applied? 

The  two  questions  are  closely  related  in  that  they  are  both  concerned  - 
with  the  immediate  application  of  factor  analysis  results  to  the  practical 
problem  of  predicting  personnel  performance,  USAPRO  has  considerable 
research  evidence  indicating  that  tests  developed  to  measure  factors  do 
not  predict  performance  aB  well  as  factorially  complex  tests  developed  to 
predict  a  specific  Army  performance  measure.  We  have  very  little  evi¬ 
dence  bearing  on  our  own  factor  measures,  since,  on  theoretical  grounds, 
we  have  not  expected  factor  measures  to  have  immediate  use  as  predictors. 
Factors  are  useful  constructs  becaueeof  their  simplified  (i.  e.  ,  more 
easily  understood}  relationships  with  psychological  or  physiological  mea¬ 
sures  and  the  other  factors.  Thus,  factor  scores  are  useful  in  experi¬ 
mentally  testing  hypotheses  relating  carefully  defined  psychological  con¬ 
tent  of  a  measure  jfp  human  performance,  and  the  factor  concept  has  gen¬ 
eral  usefulness  for  the  better  understanding  of  the  psychological  content 
of  a  battery  of  tests.  It  is  not  expected  that  factors  will  have  immediate  use- 
ftilns 2 s  sis  operational  predicts rs. 
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Formulae  and  Notation 

1.  Certain  letters  will  be  used  consistently  to  denote  specific  kinds  of 
matrices.  Different  matrices  of  the  same  type  will  be  discrimin¬ 
ated  by  their  subscripts. 


a  gramian  matrix  whose  elements  are  product  moment 
correlation  coefficients. 


&  principal  component  factor  solution. 

an  orthogonal  eigen  vector  matrix  derived  from  a  gramian 
matrix. 

eigen  value  matrix. 

a  factor  solution  other  t\  n  a  principal  component  factor 
solution, 

a  transformation  matrix  whose  elements  are  cosines  of 
the  angles  between  reference  vectors  (factors). 

..  t’i  •  1  .  '•  .  . 

II,  The  following  formulae  relate  several  of  the  above  matrices: 


A'RA 

FF' 


:.n  D, 
=  R, 


AD1/2  a  P,  PP'  ■  R, 
F'F  D 

;  T  »  (F'F  )“l  F'  F 
*  l  y  y  y  x 


P'P  ■ 


IK 
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Problem:  In  order  to  fit  a  factor  solution  of  k  factors  (i.  e.  .  P  ,  ) 

yk 

in  the  second  sample  to  a  rotated  factor  solution,  F  ,  in  the  first  sample/ 

(i.e.  ,  P  ,  T  =  F  ),  compute  T  such  that  tr  (P  .  T  -  F  )'(P  T  -  F  ) 
vk  n  X  O  '  yk  o  ¥  yk  o  x  , 

Is  minimized,  while  meeting  the  side  con strairtt  that  T*  =  T“1  . 

o  o 


Solution: 
(«)*  T, 


(P*.  F  F1  P  )"^/^p«  F  ,  P  contains  the  k  columns  of 
'  yk  x  x  yk'  yk  x  yk 


F  ,  the  complete  principal  component  factorization  of  R  ,  corresponding 

y  1/2  ■  y 

to  the  k  larger  root*  of  D  ,  P  ■  A  £l  '  where  A*  R  A  ■  D  and  R 

y  y  !;  y  y  y  y  y  y  y 

is  the  product  moment  correlation  matrix  for  the  experimental  variable# 
in  the  second  sample.  . 


(b)  T. 


can  alio  be  computed  from  the  least  square  transformation, 

S  ■■  .••«1  \ 

1  T.  »  D  P»  F  . 

1  ■/  yk  yk  x  "  . 


§ 


T  /*  (D  T,T»  D 
o  '  y  1  1 


r1/2  n 


y  11  y  y  1 


(c)  A  slightly  different  orthogonal  transformation  matrix,  T  ,  can 
be  derived  by  directly  orthogonalising  the  as  follows:  ^ 


TJX  =  T»  ,  T'X»T, 
1  ..  P  P  1 


-plY  B  Y 


1 


/rr»  Wl 
'"1*1 ' 


•  ! 


♦ 

Green,  B,  F,  The  orthogonal  approximation  of  an  oblique  structure  in 
factor  analysis.  Psychometrika,  1952,  17,  429-440. 
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TP  = 

Properties  of  T^: 

The  orthogonally  transformed  factor  solution,  ,  retains  the 

maximum  reproduction  of  R (1.  e.  ,  ^y^o^o  *  ^yk^yk^’  ^*en 
communalities  are  substituted  for  ones  in  the  diagonals  of  R^  and  if  the 
rank  of  R^  becomes  K,  this  is  undoubtedly  the  best  procedure  for 
fitting  F  , 

V.  Alternative  Procedure 

A  non-square  (orthonormal)  transformation  matrix  permitting  the  full 
utilisation  of  can  be  developed  as  follows: 

k,  Whereas  in  the  previous  model  provided  a  least  square  fit, 

T,  In  the  model  below:  provides  an  exact  fit  (since  P  has  an  inverse 

while  F  .  does  not  when  k  <  n. )  ' 

yk 

p  T„  a  F  !  If,  a  p"1  •  F  a  D'1/2  A1  F 

y  2  x  '  2  y  x  y  y  x 


b.  The  factor  matrix  F^,  computed  and  rotated  in  Sample  1, 

cannot  usually  be  obtained  by  an  orthogonal  or  orthonormal  transfor¬ 
mation  of  P  ,  computed  in  Sample  2.  The  transformation  of  P 

If  ....  i 

into  a  solution!: within  an  orthogonal  frame  F  ,  can  be  accomplished 
as  follows:  y 


P  T, 

y  2 


(A 


1  i*\ 

ldLv“ 


Cv  While  the  matrix  Fy^  contains  K  column  vectors  (factors) 
spanning  the  same  space  as  the  oblique  factors  in  F^,  the  orthogonal!- 


SE  W?6 
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zation  was  not  accomplished  in  such  a  way  as  to  maximize  the  fit  of 
F  to  F^.;-  The  additional  transformation  required  to  effect  this 

fit  can  be  accomplished  by  using  Green's  procedure  to  obtain  orthogonal 

matrix  T  .  as  follows: 
o2 


F  T  T  =  F 
yL  02  '  x 


T  «  (F'  _  F  F»F  t )  /  F' j  F 
o2  yL  x  x  yL'  yL  x 


T  a 
°2 


D‘1//Z  A'  (F'  F  )2  A.  D:l'/Z1  mlf*  d!1/2A'  (F'F  ) 
L  L  '  x  x'  L  L  J  L  L'  x  x  ■ 


d.  Thus  the  ortnonormal  transformation  matrix  T  Which  mini- 

m 

mice's  the  trace  (P  T  -  F  )'(P  'TV  -  F  ),  where  T  is  an  n  x  k 
y  m  x  y  m  x  m 

orthonormal  matrix  is,  ^  » 

T  *»  T  A  D‘1//Z  [ D'1/2  A'  (F>  F  )Z  A  d"1//2|  '^2  D"1/2  A'  (F»F  ) 
m  2  L  L  L  L  '  *  x'  L  L  j  L  L'  x  x. 


VI.  An  orthonormal  transformation  matrix  providing  a  least  square 

fit  of  T  to  T_,  as  compared  to  the  fit  of  F  .  to  F  in  Part  V,  can 
n  2  yL  x 

be  provided  as  follows: 

a.  The  conversion  of  T  to  an  orthonormal  matrix,  T^, 
spanning  exactly  the  same  space  can  be  accomplished  as  follows: 


T’  T  -  R 
2  2,  L 


T  a  X  A-  D"^2  ;  T^  T  —  I 
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b.  While  Tj  is  an  orthonormal  matrix,  it  is  not  the  orthonormal 
matrix  with  the  best  least  square  fit  to  T  ,  There  is  still  the  need  to 

Lt  .1 

minimise  the  trace  of  (T  T  -  T  J'(T„T  -  TJ,  where  T  is  an  ortho- 

&  02  2  3  02  2  02 

gonal  matrix.  This  can  be  accomplished  by  making  uit  of  Green's  pro¬ 
cedure  described  under  lV{a). 

T  ■  /ti  T  T'  T 
02  '  3  2  2  3'  1 3.  2 


r3T2  .  .  p;‘lRl  .  p.L  ,  .Inc.  p;‘l  -  D^2AL 


to2  *  <pk. P*i/1/V.  ■  °-.‘A 


xL 


pi 


xL 


1  -  A' 

o2  L 


c.  Thus  the  n  x  k  orthonormal  transformation  matrix  T 

* 

which  minimi aes  (  in  the  least  square  sense  )  trace  (T^  -  T^)' 

(T  -  TJ  is  equal  to, 
n 

T3To2  “  T2ALDi/2AL  ■  Tj,  (T'gTjj)"1/2  - 


Tn. "  T2  <T'2T2> 


•1/2 


*!£**  4**  fkii  fAStSM  »ViA  MMSMMMSik*  fa.MuU.  •  *» 

•'**'  . - *^r  — -  -«7  — -  AWS  HtSVMWW  MWVM  .»% 

describe  T  and  T  .  T  «  (T,T')-l/2  T  . 

n  p  p  'll'  1 
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APPENDIX  H 


The  Comparison  of  Transformation  Matrices 


I,  Method 


The  variables  included  in  the  rotated  factor  solution  in  the  first 
sample  are  designated  by  x  and  the  rotated  factor  solution  by  F 

The  same  (i.  e.  ,  overlapping)  variables  in  the  second  sample  are  desig¬ 
nated  by  y  and  the  non -overlapping  variables  by  a.  The  factorisation  . 

of  R  and  R  are  accomplished  as  P  *  R  A  B"1/^  and  F  s  R  AD', 
y  B  y  y  y  y  z  ye  y  y 

The  transformed  factor  matrices  in  Sample  2  are  F  a  P  T  and  F  * 

yr  y  zr 

F^T.  Each  transformation  matrix,  T,  computed  by  the  methods  des¬ 
cribed  in  Appendix  1,  is  evaluated  by  determining  the  fit  of  F  ^  to  F^ 

and  the  reproduction  of  Ry  by  F^^F^  ,  R^  by  F^^FJ^  and  R^  by 

F  F,  ,  This  is  determined  by  comparing  (for  the  different  T  matrices) 
zr  zr 

the  traces  of  the  following  product  matrices* 

(F  -  F  )'(F  -  F  )  ,  (F  F»  -R  j  1  (F  F'  -  R  ) 

yr  x'  '  yr  x'  1  z t  yr  yz  zr  yr  y* 

(F  JF'  -  R  )  <  (F  F4  -  R  )  ,  and,  after  setting  diagonal 

zt  zr  z  zr  zr  z  ■ 

elements  of  F  F'  and  R  equal  to  zero,  (F  F'  -  R  )'(F  F*  -  R  ), 
yr  yr  y  ’  yr  yr  y  yr  yr  y' 

II,  Results 

The  sums  of  squares  of  the  residual  matrices,  computed  as  the  traces 
of  the  matrices  indicated  in  Part  I  above,  are  provided  in  Table  1  for  a  study 
Involving  physical  proficiency  measures.  The  x  sample  consisted  of  254 
Wf»nt;  Pnint  cl**.  ■.?  of  1949-  The  y  ccntH.in.sd  294  West 

Point  Cadets  of  the  class  of  1964,  Table  2  relates  to  a  study  involving 
the  following  x  and  y  variables  (ih  samples  1  and  2  respectively):  15 
•'Personality"  tests,  9  information  tests,  and  8  mental  aptitude  tests.  Five 
rating  variables  based  on  performance  as  Infantryman,  m4ke  up  the  z  vari¬ 
ables.  Sample  one  (x  variables)  had  550  examinees  and  sample  two(y  vari¬ 
ables)  had  375  examinees. 


The  rank  ordering  of  the  magnitudes  for  the  various  entries  in  Tables 

l  and  2  can  be  readily  predicted  from  the  algebraic  formulations  of  the  T's. 

The  relatively  efficiency  for  fitting  F  ,  going  from  high  to  low,  is  T 

x  m, 

T^,  T^,  T^.  The  relative  efficiency  for  reproducing  the  R  matrices  is 

the  same  for  all  Tra  which  are  either  orthogonal  or  capable  of  being  linked 
by  an  orthogonal  transformation,  Thus  all  the  orthogonal  T  matrices!; 
have  more  efficiency  for  reproducing  R^,  when  applied  to  PC  solutions  of 

Ry,  than  do  the  orthonormal  transformation*! 


l'.  . 


:  *$sspPij?R! m .. 
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SOME  LEAST -SQUARES  TRANSFORMATIONS  OF  REGRESSION 
ESTIMATORS  OF  ORTHOGONAL  FACTORS 

Emil  F.  Heermann 

U.  S,  Army  Personnel  Research  Office  j 

This  paper  provides  a  brief  introduction  to  the,factor  analysis  model 
used  by  psychologists  and  presents  some  methods  for  transforming  re¬ 
gression  estimators  of  orthogonal  factors  to. a  more  useful  form. 

1.  THE  FACTOR  ANALYSIS  MODEL.  Factor  analysis  is  a  mathe¬ 
matical  method  for  representing  n  correlated  measures  obtained  on  N 
Individuals  by  means  of  a  linear  combination  of  hypothetical  measures, 
called  factors.  Psychologists  draw  a  distinction  between  common  factors, 
which  are  related  to  two  or  more  measures,  and  specific  factors  which 
are  related  to  only  on*  of  the1  original  measures.  in  general.;  then,  the 
linear  model  postulates  n  specific  factors  and  r„  common  factors  where 
r  is  less  than  ths  number  of  measures  n.  The  sampling  theory  for 
such  a  model  is  not  yet  thoroughly  understood  and  this  paper  will  con¬ 
fine  itself  to  algebraic  rather  than  statistical  considerations, 

The  linear  model  of  factor  analysis  can  be  moat  conveniently  pre¬ 
sented  in  the  form  of  matrix  equations: 

(1)  Z  *  Z0F'  ♦  ZfS'  ,  where  / 

Z  ■  N  x  n  matrix  of  observed  measures  (aero 
mean,  unit  variances) 

Zc»  N  *  r  matrix  of  common  factor  scores 

F'  a  r  x  N  matrix  of  common  factor  weights 

Zg  -  N  x  n  matiix  of  specific  factor  scores 

S'  =  n  x  n  diagonal  matrix  of  apecific  factor 
weights 

Terms  on  the  right  eid*  of  the  equation  are  all  unknown.  In  (1)  it  Is  - 
assumed  that: 


I 


S’,> 
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(2) 

(3) 

(4) 
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-Z1  Z  =  I, 
N  c  c  1 


—  z*  z  =  r 

N  as  n 


—  Z' 
N 


Z 

c  s 


These  assumptions  allow  ua  to  find  F'  and  S'  from  the  observed 
measures,  but  before  we  examine  this  procedure  it  is  important  to  indi¬ 
cate  a  rather  serious  difficulty  with  our  linear  model.  When  we  postu¬ 
late  nit  factors  to  explain  n  measures  this  invariably  means  that 
there  exist  multiple  solutions  for  an  individual's  factor  scores,  Solutions 
exist  because  the  linear  equations  are  consistent  but  the  rank  of  trie  co¬ 
efficient  matrix  does  not  allow  unique  solutions,  To  get  around  this 
difficulty  psychologists  have  utilised  least-squares  procedures  for  esti¬ 
mating  the  factor  scores  from  the  observed  measures,  and  we  shall 
examine  the  defects  of  these  estimators  at  a  later  pdint. 

i  !.,  We  now  return  to  the  problem  of  finding  F'  and  S'  from  the  observed 
data.  Because  of  (2),  (3)  and  (4)  we  may  write:  ,j 


1 


R  -  Z'Z  ■  FF'  +  SS',  or 
N 


R  -  SS'  ■  .  FF' 


Since  SS*  is  a  diagonal  matrix,  we  begin  by  estimating  values  for  SS1  and 
then  obtain  the  eigenvectors  and  eigenvalues  of 


R  -  SS'  -  AKA',  where 

A  *  n  x  r  matrix  of  eigenvectors 
K  b  r  x  r  matrix  of  eigenvalues 
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Now,  F  =  AK  '  ,  and  the  sums  of  squares  of  the  rows  of  F  are  used 

to  obtain  new  values  of  SS1,  and  the  process  is  continued  until  R  -  SS1 
is  fit  with  the  minimum  rank  F.  This  whole  process  may  be  thought  of 
as  finding  a  set  of  values  for  SS1,  such  that  R  -  SS1  is  of  minimum  rank,  : 

It  will  be  noted  that  F  is  arbitrary  up  to  an  Orthogonal  transformation 
and  it  is  riecessary  to  postulate  some  method  for  finding  a  psychologically 
meaningful  F.  Psychologists  follow  L,  I,j,  .Thurstone  here  and  attempt 
to  transform  the  arbitrary  F,  bo  that  it  approximates  "simple  structure", 
i.e.  ,  has  a  maximal  number  of  zero  or  near-zero  entries.  To-accom- 
plish  this  we  find  some  orthogonal  transformation,  X  >  such  that 

FX  ’  Fs 

‘where  VA  a  I,  and 


Fr  approximates  "simple  structure",  A  considerable  number  of  computer 
programs  exist  which  determine  by  analytical  means  the  best  transfor¬ 
mation  X  • 


II.  ESTIMATION  OF  FACTOR  SCORES.  Assuming  now  that  F 
is  adequately  fixed,  our  problem  is  then  to  find  the  values  of  Zc  and 

ZB  that  will  satisfy  the  linear  model  specified  in  (1).  Since  an  infinite 
set  of  such  factor  scores  exist,  psychologists  commonly  turn  to  a  re¬ 
gression  method  for  estimating  2C  for  a  fixed  ZB>  We  are  primarily 

interested  here  in  finding  values  for  Zf  ,  and  the  least-squares  solution 
for  Zc  is  easily  found  to  be 


But  unlike  the  factor  scores  Z0,  these  estimators  are  intercorrelated, 
because 


(5) 


o 


A 

z 


c 


F'rR 


-1, 


the 


covariance  matrix  of  the  least-squares  estimator  is  not  diagonal,  Ad¬ 
justing  the  covariance  matrix  so  that  we  have  an  intercorrelation  matrix 
gives:  ;; 
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D"1  pi  R‘l  p  D'1 
e  R  Re 


where 

Dfi  s  r  x  r  diagonal  matrix,  formed  from  the  square  roots  of  dia¬ 
gonal  entries  of  (5),  the  covariance  matrix. 

A  further  practical  difficulty  ie  that  regression  estimators  all's  not 
univocal,  i.  e,  ,  each  estimator  is  correlated  with  more  than  one  common 
factor.  This  can  be  seen  by  examining  the  matrix  of  correlations  be¬ 
tween  the  factor  scores  and  the  least-  squares  estimators,  which  is 

ii  RfL  “  De  RL* 

It  is  not  too  difficult  to  derive  transformations  of  the  beta  weights 
used  in  the  regression  estimators  that  remove  these  defects,  but  it  is 
not  possible  by  means  of  a  single  transformation  to  simultaneously  re¬ 
move  both  defects.  , 

To  adjust  for  non-orthogonality,  we  first  find  an  arbitrary  sst  of 
orthogonal  vectors  that  serves  as  a  vector  basis  far  the  regression  esti¬ 
mators.  To  do  this  we  find  an  r  x  r  T,  such  that 

Rl  m  TT' 

The  elements  of  T  represent  the  correlations  of  the  least-squares  esti¬ 
mators  with  the  r  orthogonal  axes,  The  correlations  of  the  factors  with  '] 
the  orthogonal  axes  are  given  by 


%  =  DeT' 


and  to  find  the  beet  set  of  orthogonal  axes  we  must  transform  T  so  that 
DgT  most  closely  approximates  the  diagonal  matrix  Dft.  In  matrix 
algebra,  we  wish  to  find  a  X  ,  such  that  if 


R 


D  =  E,  then 
e 


trace  E'E  =  minimum,  and 

X  x  =  I. 
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From  a  theorem  proved  by  B.  F.  Green  (1)  we  find 

X  *<t'd4t)"1/2  t' d2  L 

6  c  . 

Nov/  if  the  requirements  of  the  psychologist  arc  such  that  it  is  more 
important  to  havS  univocal  rather  than  orthogonal  estimators  than  a 
somewhat  different  procedure  is  required.  In  this  case  we  determine 
so  that  if 

RfT  A  "  De  a  E  - 

trace  E'E  ■  minimum,  and 

\ '  ' 

Hi^i  “  'U  ■  2, ...  .  .r),  where 

X  ^  ■  I***  column  of  X. 

As  can  bs  seen  the  orthogonality  restraint  on  \  has  been  relaxed,  The 
normal  equations  for  these  conditions  are 

(8)  (T'D2T  -  X  )\'  m  T'D2  , 

■  e  e  „  li 

where  Y  «  r  x  r  matrix  of  Lsgfangian 
Multipliers.  The  above  equation  does  not  allow  us  to  find  a  matrix 
expression  for  X  which  does  not  also  involve  V  ,  Henfce  we  pursue 
a  simpler  approach  which  involves  a  least-squares  solution  for  A 
followed  by  imposing  the  restraints  that  each  column  of  X  have  sum<s 
of  squares  eqvjtal  to  unity.  With  this  approach  we  find  that 

'  m  1 

X  =  T  D,  where 

D  is  the  diagonal  matrix  of  constants  heeded  to  adjust  T’1  so  that  the 
column  sums  of  squares  equal  unity,  When  the  least-sqilares  estimators 
are  transformed  by  Xj^  we  fint^ 'that  the  matrix  of  correlations  between 

Zc  and  our  transformed  estimators  is  =  DflD,  which  is  quite  obviously 
a.  -diagonal  matrix. 
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III,  AN  APPLICATION  OF  THE:  TRANSFORMATIONS.  In  1954  A  PRO 
carried  out  a  factor  analysis  of  visuajl  acuity  tests  administered  during 
dark  adaption.  The  examinees  in  this  experiment  were  100  soldiers 
from  Fort  Myer,  Virginia.  The  design  of  the  experiment;  called  for  pre¬ 
adapting  subjects  to  a  high  brightness  level  and  then  during  the  period  of 
dark  adaption  the  examinees  were  tested  on  visual  acuity  targets  pre¬ 
sented  at  scotopic,  mesopic,  and  low  photo  pic  brightness.  The  various 
acuity  tests  (Modified  Landolt  Ring  and  Chevron  Contrast  Adoption  tests) 
were  presented  in  a  modified  Armed  Forces  Vision  Test. 

The  35  variable  intercorrelation  matrix  obtained  in  this  experiment 
yielded  8  orthogonal  factors  which  were  rotated  to  orthogonal  simple 
structure.  To  illustrate  the  derivations  presented  in  this  paper,  a  sub- 
matrix  was  selected  from  the  35  x  8  complete  factor  matrix.  Table  1  gives 
this  submatrix. 

Table  1 

Illustrative  Factor  Matrix 

t 

E  .  ■  ..  ■  1  .  . 


Variable  Name  < 

I 

II 

III 

IV 

JLandolt  Scotopic 

1 

.  84 

.07 

.  13 

•  34 

Landolt  Low  Fhotopic 

"  z  ' 

.  16 

.£5 

.03  • 

.13 

Chevron  Scotopic 

3 

.28 

.  32 

.  12 

.75 

Chevron  Mesoplc 

4 

.01 

.  03 

,  79 

.29 

Factor  1  was  interpreted  to  represent  "Rod-Adapted  Resolution")  Factor  II 
was  interpreted  to  represent  "Cone  Adapted  Resolution";  Factor  III  was  in¬ 
terpreted  to  represent  "Cone  Adapted  Brightness  Discrimination",  and 
Factor  IV  was  interpreted  as  "Rod-Adapted  Brightness  Discrimination". 

Table  2  compares  the  classic  regression  equations  approach  to  esti¬ 
mating  these  four  factors  with  the  methods  derived  in  this  paper.  As 
noted  previously  the  least-squares  estimators  are  intercorrelated  and 
fail  to  be  univocal.  The  univocal  estimators  achieve  an  ideal  pattern  of 
correlations  with  the  factors  but  they  are  intercorrelated  somewhat  more 
than  the  least-squares  estimators.  The  orthogonal  estimators,  while  Un- 
coreelated,  are  not  univocal  although  they  are  closer  to  bbing  univocal 
than  the  least-squares  estimators.  Inevitably  then,  choice  of  any  One 
solution  means  that  certain  defects  must  be  tolerated.  From  the  results 


I  ■  ..  ' 
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presented  in  Table  2  it  would  appear  that  the  orthogonal  estimators  re¬ 
present  something  of  a  compromise  between  the  maximum  validity  of  the 
least-squares  estimators  and  purity  of  the  univocal  estimators. 


I 


s 


»  I 


s 


ii 


^Green,  B.  F.  The  orthogonal  approximation  of  an  oblique  structure  in 
factor  analysis.  Psychometrika,  1952,  17.  429-440, 


A  RELIABILITY  TEST  METHOD  FOR  “ONE-SHOT"  ITEMS 

H.  J.  Langlie 

Aeronutronic  Division,  Ford  Motor  Company 

1.  INTRODUCTION.  As  a  result  of  many  reliability  problems  which  have 
plagued  procuring  agencies  in  the  missile  and  space  programs,  increased 
emphasis  has  been  placed  on  the  development  of  improved  reliability  demon¬ 
stration  test  methods.  In  this  connection,  the  Army  has  advocated  increased 
use  of  the  “test -to -failure"  concept  to  establish  the  existence  of  satisfactory 
margins  of  reliability  with  respect  to  critical  factors.  This  philosophy  has 
the  advantage  in  that  statistical  statements  can  be  made  regarding  reliability 
on  the  basis  of  relatively  small  samples.  This  paper  will  discuss  the  appli¬ 
cation  of  this  general  concept  to  a  particular  class  of  hardware. 

In  essence,  the  “test-to-fallurs"  concept  Involves  submitting  a  test 
speeimefv  to  an  increasing  environment  or  load  stress  until  failure  is  detected. 
By  observing  the  statistical  behavior  of  the  stresses  at  which  failure  occurs, 
the  lowei  limit  of  stress  below  which  the  probability  of  failure  is  very  small 
can  be  selected  by  using  the  mean  and  standard  deviation  of  these  data. 

Robert  Lusser  (reference  1)  advocated  the  safety  margin  concept  in  inter-  |( 
preting  these  data.  As  is  shown  in  Figure  1,  the  larger  the  value  of  k 
(which  is  the  distance  from  the  mean  strength  to  the  upper  limit  of  the  oper 
ating  applied  stress  divided  by  the  standard  deviation  of  the  data),  the 
greater  the  reliability  of  the  specimen  with  respect  to  the  stress  involved, 


ii  if 

"  5 


In  establishing  the  reliability  objectives  for  the  Shillelagh  Program,  the 
Army  Missile  Command  required  that  safety  margins  be  demonstrated  in 
the  test  laboratory  for  Shillelagh  components  with  respect  to  critical  environ¬ 
mental  stress  factors.  Many  of  these  components  are  of  a  "go-no-go"  type 
such  as  thermal  batteries,  electrical  relays,  and  other  short-lived  equip¬ 
ment  items,  In  most,  cases,  little  information  was  available  prior  to  teat 
regarding  the  nature  of  the  standard  deviation  of  the  distribution  of  strenghts 
for  these  parts.  Furthermore,  it  was  desired  to  perform  a  laboratory  test 
involving  a  minimum  number  of  samples.  A  review  of  attribute  sensitivity 
testing  techniques  such  as  the  Up  and  Down  method  (reference  2)  and  the 
Probit  method  (reference  3)  indicated  that  these  methods  cannot  applied 
satisfactorily  under  the  sample  size  and  technical  limitations  imposed.  As 
a  result,  a  study  was  made  to  develop  a  method  for  selecting  stress  levels 
for  testing  which  required  no  a'priori  assumption  regarding  the  standard 
deviation  of  the  unknown  strength  distribution  and  could  be  performed  satis¬ 
factorily  with  sample  sizes  of  the  order  of  fifteen  or  twenty. 


i 

1 


ENVIRONMENT  SCALE 
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Detailed  empirical  investigations  were  performed,  using  Monte  Carlo 
methods  with  a  high  speed  digital  computer,  to  develop  a  satisfactory 
algorithm  for  determining  successive  stress  test  levels  as  the  experiment 
proceeds.  Eixact  maximum  likelihood  equations  were  used  to  calculate  the 
statistical  estimates,  fi.  ,  and  c  ,  of  the  population  parameters,  t*- 
and  tr,  of  the  distribution  of  part  strengths.  By  repeated  simulations  of 
experiments  for  sample!  sizes  ranging  from  ten  to  900,  empirical  curves 
were  obtained  showing  the  variance  in  the  calculated  estimates  vs  sample 
size.  After  this  study  was  complete,  a  technical  report  was  prepared 
(referenda  4).  Thd  paper  today  will  discuss  some  significant  results  con¬ 
tained  in  this  report. 

Since  the  completion  of  the  study,  several  applications  have  been  made 
in  reliability  testing  electrical  and  mechanical  components.  One  such 
application  is  presented  in  this  paper  by  way  of  illustration, 

2,  DISCUSSION.  In  order  to  proceed  with  the  discussion  of  the  test 
method,  a  specific  definition  is  given  regarding  the  terms  "  atre  so  "  and 
"strength"  as  follows; 

Stress  Is  a  teat  factor,  such  as  environmental  level  or  force  level 
which  Is  applied  to  the  test  specimen.  Operational  stresses  repre¬ 
sent  the  mix  of  environmental  or  load  conditions  that  can  be  expec¬ 
ted  to  be  Imposed  on  a  typical  specimen  during  its  life.  During  the 
conduct  «f  a  "one-shot"  test,  the  stress  represents  the  applied  test 
factor  which  is  varied  in  rihagnitude  fjrom  specimen  to  specimen  in 
a  systematic  mannisr,  ,  j- 

Strength  is  a  property  ascribed  to  a  specimen  such  that  if  the  stress 
imposed  on  the  part  is  greater  than  the  strength  of  the  part,  the 
part  will  fail.  Conversely,  if  the  stress  is  less  than  the  strength  of 
the  part,  the  part  will  not  fail, 


Failure  in  the  sense  used  above  is  a  general  term  referring  to  unsat¬ 
isfactory  completion  of  function,  out  of  tolerance  performance,  breakage, 


ny  oth? T  SVicItSiCft  ftf  ItiilfURCtior.,  f'CT  ClCh  tCSt  dttCX 


*  live  wsii  u  obiosn 


is  applied  to  a  specimen,  there  is  associated  an  outcome  which  is  a  binary 
variable:  success  or  failure, 


It  is  assumed  that,  given  a  homogenous  sample  of  replicate  specimens, 
the  part  strengths  are  distributed  normally  with  an  unknown  mean  and 
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standard  deviation.  The  purpose  of  the  test  method  is  to  select  stress 
levels  in  such  a  way  as  to  generate  outcomes  which  can  then  be  used  to 
fcalculate  statistical  estimates  of  the  parameters  of  the  distribution  of 
■'  part  strengths. 

3.  PERFORMING  THE  TEST,  In  undertaking  to  perform  the  "one- 
shot"  test,  there  are  three  steps  to  be  taken  which  should  be  followed 
regardless  of  the  nature  of  the  application.  They  are: 

1.  Establish  the  criteria  of  failure,  or  acceptance, 

2.  Determine  the  test  interval. 

3.  Select  the  stress  levels. 

The  last  of  these  three  steps,  selecting  the  stress  levels,  proceeds  con¬ 
current  with  the  actual  performance  of  the  test.  Those  three  step*  are 
discussed  below, 

3,1  Establishing  Failure  Criteria. 

It  is  very  important  that  painstaking  care  be  given  to  the  set  of  ground 
rules  which  will  be  followed  for  differentiating  between  a  success  or  a 
failure.  For  purposes  of  reliability  testing,  ' this  means  that  a  careful 
enumeration  should  be  made  of  all  undesirable  responses  of  a  tsst  speci¬ 
men,  such  as  particular  modes  of  failure,  out  of  tolerance  performance, 
and  any  other  mode  of  unacceptable  product  performance.  These  criteria 
are  the  very  basis  for  establishing  product  assurance  in  the  laboratory  and 
should  be  reviewed  and  approved  by  all  qualified  parties  having  a  technical 
interest  in  the  product, 

3,  2  Determining  the  Test  Interval, 

In  order  to  proceed  with  a  generation  of  stress  levels  for  testing  purr 
poses,  it  is  necessary  to  choose  a  tost  interval  which  is  used  as  a  basis 
for  the  stress  sequencing  method.  This  interval  should  be  selected  large 
enough  to  include  all  possible  ranges  of  strengths  of  the  parts  to  be  tested, 
Thin  interval  can  be  made  conservatively  large,  since  the  "one-Bhot"  method 
has  been  designed  to  cause  the  stress  levels  to  be  generated  in  the  vicinity 
of  interest  (i ,  e .  ,  in  the  vicinity  of  the  distribution  of  strength*)  » ■  ?hs 
test  proceeds.  As  a  sample  illustration,  the  range  for  a  drop  height  test 
for  glass  containers  designed  to  withstand  say,  a  six  inch  drop,  could  be 
chosen  to  have  a  lower  limit  of  zero  and  an  upper  limit  of  three  feet.  The 
method  of  analysis  of  the  data  is  such  that  the  particular  choice  of  the 
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endpoints  of  the  test  interval  do  not  have  an  appreciable  effect  on  the 
results  for  sample  sizes  of  fifteen  or  more.  In  the  event  that  the  test 
interval  turns  out,  as  the  test  proceeds,  to  be  inappropriately  chosen, 
then  the  stress  levels  will  tend  to  converge  towards  one  limit  or  the 
other.  In  such  an  event,  particularly  in  the  case  of  reliability  testing, 
convergence  towards  the  lower  level  is  usually  indicative  of  a  totally 
unsatisfactory  product,  whereas  convergence  towards  the  upper  limit 
can  be  shown  to  be  statistically  acceptable  by  use  of  the  likelihood  ratio 
test,  . 

In  Figure  2  there  is  represented  the  results  of  an  actual  "one-shot11 
test  on  thermal  batteries  to  determine  the  reliability  with  regard  to  high 
temperature.  In  this  Instance,  the  batteries  were  designed  to  perform 
reliably  at  14?°F.  On  the  basis  of  conservative  engineering  judgement 
and  some  limited  development  test  data,  the  lower  limit  was  selected 
to  be  100°F  (the  level  at  which  all  thermal  batteries  would  be  expected 
to  perform  satisfactorily)  and  the  higher  limit  was  selected  to  be  350°F 
(the  level  at  which  all  thermal  batteries  would  be  expected  to  fail). 

3.3  Selecting  the  Stress  Levels, 

Once  the  test  interval  and  failure  criteria  have  bean  established,  the 
test  commences  by  selecting  the  first  stress  level  at  the  midpoint  of  the 
interval.  After  exposing  the  first  specimen  to  this  environmental  level 
and  activating  it,  a  one  or  zero  is  recorded  to  indicate  the  outcome  as  a 
success  or  failure  respectively  (see  Figure  2). 

The  general  rule  for  obtaining  the  (n  +  l)#t  stress  level,  having  com¬ 
pleted,  n  trials;  is  to  work  backward  in  the  test  .sequence,  starting  at 
the  n  ”  trial,  until  a  previous  trial  (call  is  the  p  -  trigjl)  is  found  suc^ 
that  there  are  as  many  successes  as  failures  in  the  p  through  the 
trials,  The  (n  +1;  stress  level  is  then  obtained  by  averaging  the  n 
stress  level  with  the  p  1  stress  level.  If  there  exists  no  previous  stress 
level  Satisfying  the  requirement  sta^d  above,  then  the  (n  +  1)  stress 
level  is  obtained  by  averaging  the  n  n  stress  level  with  the  l^wer  or  upper 
stress  limits  of  the  test  interval  according  to  whether  the  n  result  was 

A  mm  4  niaw-BRR 
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To  illustrate,  suppose  if.  is '.desired  to  find  the  second  stress  level  in 
Figure  2.  Since  there  was  only  one  previous  observation  (i.  e. ,  first 
unit  failed)  it  is  not  possible  to  find  a  stress  level  where  all  intervening 
results  even  out.  That  is,  the  second  stress  level  iB  obtained  by  averaging 
the  first  with  the  lower  limit.  To  find  the  eighth  stress  level,  it  ob¬ 
served  that  results  from  test  4  through  7  (i.  e. ,  the  last  four  results)  can¬ 
cel  ^ach  other  Out.  Thus,  the  eighth  stress  level  is  obtained  by  averaging 
the  fourth. 
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stress  level  with  the  seventh. 

As  a  final  example,  it  is  observed  that  after  the  twelfth  test  has  been 
completed,  there  again  exists  no  previous  stress  level  for  which  the 
number  of  failures  equals  the  number  of  successes.  Since  the  twelfth 
test  was  a  failure,  the  thirteenth  stress  level  is  obtained  by  averaging  the 
twelfth  stress  level  with  the  lower  limit. 

As  an  aid  in  identifying  the  important  parameters  of  the  test,  the  stress 
level  is  designated  by  the  letter  s  and  the  outcome  Is  designated  by  the  ' 
letter  u.  The  lower  limit  of  the  test  interval  is  designated  A  and  the 
upper  limit  is  designated  B,  Upon  the  conclusion^  ofthe  test,  the  stress 
values,  (Sj,  s^,  . ,  . ,  s^),  and  the  corresponding  outcomes,  (u^,  u^,  u^), 

where  N  equals  the  test  sample  size,  are  used  to  perform  a  complete  anal¬ 
ysis  for  hardware  reliability. 

:v.  :  •  ■ 

4,  DERIVATION  OF  MAXIMUM  LIKELIHOOD  EQUATIONS.  Consider 
the  random  sample  X  m  x^,  .  .  ,  ,x^)  of  N  observation*  where  the  x{ 

are  independent  random  variable  from  a  Gaussian  distribution,  8(*S/a.  <0. 
with  mean  |A-and  standard  deviation  o’.  Consider  also  an  N-dimeniional 
vector  S  *  (Sj,  s^,  *  •  .. *j^)  where  A£Sj£B.  'From  this,  construct  a  third 

vector  U  »  (u.,u,,  ,  ilv)  where 

6  N  u’  ■  1  if  s^Xj  •  . 

l-  •  llj^ 

The  variable  x.  is  called  the  strength  of  the  i  part;  s.  is  called  the 
1  th  *  ' 

applied  stress  level  for  thb  i  part,  and  u,  is  called  the  outconvp  of  the 

"test"  on  the  i  part,  The  outcome  u  «  1  is  called  a  success  (i.  e, ,  the 
applied  stress  was  less  than  the  part  strength)  and,  conversely,  u*Oii 
called  a  failure. 

The  object  of  this  development  is  to  obiain  formulas  for  calculating  the 

eatimataa  i/  and  it  nf  u  and  it  eivan  nnlv  Sand  IT  This  V/iil  b“ 

. . . '  e  s  '  ' 

accomplished  by  obtaining  values  of  f-C  and  c  which  maximize  the  like¬ 
lihood  (i,  e, ,  probability)  of  obtaining  the  outcoftie  U  given  S. 

The  probability  of  outcome  u^  given  can  be  written 
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(1)  Oi  =  Prob 
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/■co  “  r 

[ui(  aija  uii8,  g(v;AA-»r)dv  +  (J  -  uij[_^8(v;/u.,«r)dv 


The  probability  of  outcome  U  can  be  written  as  the  product  of  the  proba¬ 
bilities  of  the  individual  u^  since  the  are  independent. 


<*) 


[y]  =  ff  P,  B  Mm*  r) 
i=l 


The  expression  p[u],  when  regarded  as  a  function  of  the  population  parame- 
ters^tand  <r,  becomes  the  likelihood  function  for  outcome  U  (ref.  5). 

To  find  the  values  of  ft  and  tr  (now  regarded  as  variables)  which  maxi- 
min  L,  we  differentiate  (2)  with  respect  tc^and  a-  and  solve  the  system 


Bln  L/  OfA.  >  O 
81n  h/dfJL  a  o 


(3) 


where  the  logarithm  of  L  is  used  to  simplify  the  algebra. 

Letting  t.  ■  (s,  - /U,)/<r,  gjv)  a  (2tr)  “^exp  (-v2/2),  the  normalised 
1  x  ■  o 

Gaussian,  and  remembering  that  u^  can  take  on  only  values  of  O  or  1, 
equation  (1)  can  be  re -written 

(4)  In  pt  ■  Uj  i0  (v)dv]  +  (1  -  u^lnff  1  qo(v)dv] 

The  following  definitions  (a)  and  derivations  will  be  helpful; 


(5) 

G(t)  -p  g  (v)  dv 

(6) 

J-oc 

dgo(t)/dt  *  -tgo(t) 

(7) 

dt/QfiL  =  -1/ cr 

(<r‘?  0) 

(8) 

8t/8<r  =  -t/  cr 

(<r  >  O) 

Since  InL  ^  E  In  p., 

equations  (3)  become 

(9) 


81nL,/8yU.  =  E  Bln  p^/ 8/4.  a  O 
S(nL/ 8 (r  =  E  81n  p^/ 8<r  =  O 


'  •**“<»»* 
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From  (4) 


/bll  =  'Vo(ti} 

1  -  G^)  Qfi-  G^)  0/4. 

«Jv  1-"il 


*.  *  Ll‘Gi  Gi 


where  the  arguments  (and  subscript  lo")  have  been  omitted  to  simplify 
writing.  Similarly, 

(11)  01n  p./8or  ■  tlgl  U1  t"ttt 

1  <r  1-G.  “  G. 

L  l  l  J 

Denoting  by  h.  the  expression  in  brackets  and  eliminating  the  constant  <r, 


equations  (9)  become 


dlnL/Bu.  ■  p(u,  tr)  =  25  ,g  h  =  O 

1*1  1  1 
d  N 

01nIi/0O*  ■  q (a,  <r)  *  2!  t4g|h  *  O 
r  %  i«l  1  1  1 


Equations  (12)  are  valid  only  if  the  value  of  <r  which  satisfies  the  maxi* 
mum  likelihood  equations  is  non* aero.  A  quick  examination  tit  the  data 
can  be  made  to  determine  if  a  non- aero  tr  is  a  maximum  likelihood  solu¬ 
tion.  If  the  maximum  stress  level  at  which  a  success  occurred  is  greater 
than  the  minimum  level  at  which  a  failure  occurred,  than  a  non-aero  9 
satisfies  equations  (12),  If  this  statement  is  not  true,  then  mO  represents 
a  maximum  likelihood  estimate  for  the  standard  deviation  and  the  maximum 
likelihood  estimate  of  the  mean  is  a  connected  interval  contained  between 
the  maximum  failure  stress  level  and  the  minimum  success  stress  level 
which  represent  the  lower  and  upper  bounds  of  the  interval  respectively. 

The  latter  situation  illustrates  an  outcome  which  in  fact  must  be  achieved 
if  au  of  the  part  strengths  were  concentrated  at  a  mass  point  within  the 
above  mentioned  interval,  The  maximum  likelihood  corresponding  to 
this  outcome  is  one.  Although  unique  estimates  cannot  be  obtained  for 
/4  and  <r  in  Buch  an  instance,  it  is  possible  to  provide  a  basis  for  deci¬ 
sion-malting,  using  the  likelihood  ratio  statistic  along  with  aisuitably 
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constructed  hypothesis  (reference  4),  A  result  of  this  type  is  referred 
to  as  degenerate.  It  should  be  mentioned  that,  for  a  fixed  population  t 
standard  deviation,  <y  /  0,  the  probability  of  obtaining  a  degenerate  result 
approaches  0  as  the  sample  si ze  becomes  large.  The  proof  of  these 
statements  is  contained  in  reference  4  and  is  beyond  the  scope  of  this 
paper.  ... 

5.  STATISTICAL  PROPERTIES  OF  THE  MAXIMUM  LIKELIHOOD 
ESTIMATES.  The  preceding  sections  describe  the  method  for  selecting 
stress  levels  and  the  likelihood  equations  for  calculating /U.^  and  0  . 

In  order  to  make  practical  applications  of  the  method,  however,  infor¬ 
mation  is  required  regarding  the  statistical  properties  of  the  maximum 
likelihood  estimates  corresponding  to  various  sample  To  facili¬ 

tate  obtaining  this  information,  an  extensive  computer  simulation  was 
carried  out  using  Monte  Carlo  techniques.  In  this  way,  hundreds  of  values 
of  M  and  0  could  be  obtained  corresponding  to  hundreds  of  simulated 
experiments  using  random  numbers  for  part  strengths*  Statistical 
summaries  were  then  Obtained  end  the  variance  of  the  estimates  of  the 
parameters  empirically  derived. 


To  perform  the  simulation,  a  standard  interval,  A  m  1,  B  ■  1,  was 
chosen.  The  sampling  of  strengths  was  simulated  by  converting  the  sum 
of  twelve  two-digit  numbers,  constructed  from  a  file  of  one  millions  ran¬ 
dom  digits,  to  a  random  deviate  with  population  mean M and  standard 
deviation,  er  .  Two  populations  were  employed!  p*  e  0  and  0*  0-29, 
and  P  ■  o,  2  and  Cf  ■  0,  i,  For  each  population,  one  hundred  runs,  each 
consisting  of  N  samples,  were  made  for  N  ■  4  through  15,  20,  25,  30 
and  35,  with  an  additional  four  hundred  runs  for  N  ■  15  and  N  *  30  for 
additional  information  on  the  distributions  of  the  estimates.  Finally, 
four  runs  of  N  ■  900  were  made  for  each  population  to  empirically  inves¬ 
tigate  the  asymptotic  convergence  of  (p  ,  &  )  to  (/U,  (f), 

For  each  set  of  100  runs  at  a  fixed  sample  siae,  the  mean  and  variance 
were  averaged  separately  and  plotted  as  shown  in  Figures  3  and  4.  Straight 
lines  Weie  than  fitted  to  ths  data,  recognising  that  soma  spurious  affects 
are  introduced  for  email  sample  siees  (i.  e, ,  15  or  less)  due  to  the  dis¬ 
creteness  of  the  admissible  outcomes  which  are  possible.  (For  sample 
size  of  N,  only  2N  outcomes  are  possible  corresponding  to  the  2N  possi¬ 
ble  configurations  of  0  and  1.) 


Based  on  the  results  of  Figures  3  and  4,  the  variance  of  the  estimates 
are  given  by: 
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INVESTIGATION  IN  TEMPERATURE  CONTROL  OF  HYDRAULIC  SYSTEMS 
IN  ROUGH  TERRAIN  FORK  TRUCKS 

Irving  Tarlow 

Quartermaster  Research  and  Engineering  Command 
Natick,  Massachusetts 

The  problem  of  overheating  in  hydraulic  systems  of  mobile  equip¬ 
ment  has  not  been  given  full  consideration  nor  have  the  ramifications 
been  completely  understood  by  designers  of  such  equipment.  The  effect 
of  excessive  heat  can  be  injurious  to  the  operator,  the  equipment  and  to 
persons  in  the  proximity  of  the  equipment. 

In  induatrial  applications  of  hydraulic  equipment,  space  has  not  been 
one  of  the  problems,  Hydraulic  systems  designed  on  this  premise  pro¬ 
vided  for  a  reservoir  tank  of  sufficient  fluid  capacity  to  dissipate  the  heat 
or  a  system  in  which  a  heat  exchanger  has  been  incorporated. 

This  approach  cannot  be  applied  to  mobile  hydraulic  systems,  Space 
is  not  available  for  large  fluid  reservoirs  or  heat  exchangers.  The  sit¬ 
uation  is  usually  more  aggravated  by  the  radiation  of  heat  from  the  en¬ 
gine  as  well  as  crowding  components  of  the  system  into  a  small  enclosed 
area  in  which  the  heat  from  the  system  itself  has  to  be  considered.  \ 

The  designer,  evaluating  the  heat  effect,  takes  into  consideration  the 
type  of  operation  for  which  the  equipment  was  intended.  For  commercial 
materials  handling  equipment  this  approach  has  been  for  the  most  part 
valid.  The  hydraulic  system  is  not  taxed  to  the  degree  that  heat  has  been 
a  factor.  Idle  time  between  cycles  has  been  sufficient  to  allow  cooling 
of  the  fluid  to  a  safe  temperature  level.  However,  in  Military  applications, 
where  unloading  operations  are  on  a  24 -hour  per  day  basis  and  long  road 
marches  are  a  required  operational  feature,  temperature  control  must 
be  built  in.  / 

The  condition  of  high  fluid  temperature  was  detected  in  an  All  Purpose 
Fork  Lift  Truck  having  a  6,  000-lb  capacity  at  24-inch  load  center. 

This  vehicle  is  a  Military  item  presently  in  the  supply  system  in  large 
quantities.  The  purpose  of  this  vehicle  is  to  handle  supplies,  whether 
palletized,  unitized  or  containerized,  over  rough  terrain,  in  Open  storage 
areas  and  in  all  types  of  climatic  environments  as  well  as  ail  types  of 
terrain.  ThiB  vehicle  must  be  capable  of  operating  under  conditions  of 
limited  visibility,  inclement  weather  and  blackout  and  be  capable  of 
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The  particular  hydraulic  system  on  which  the  investigation  was  con¬ 
ducted  is  of  the  open  center  type  and  consists  of  a  fixed  displacement 
pump  coupled  to  the  engine  input  shaft.  Fluid  passes  from  the  pump  to 
a  directional  control  valve  and  is  then  directed  either  to  reservoir  tank 
when  no  work  is  required  or  to  a  working  cylinder. 

It  was  necessary  to  first  isolate  the  cause  of  excessive  heating,  A 
work  cycle  was  devised  based  on  a  simulated  field  operation.  This  con¬ 
sisted  of  lifting  a  6,  000 -lb  rated  load,  transporting  it  to  a  new  site, 
stacking  the  load  and  then  returning  to  the  starting  position.  Temperature 
was  recorded  in  the  reservoir  tank  approximately  2  inches  from  the 
bottom  and  18  inches  away  from  suction  outlet.  '  v. 

Through  observation,  it  was  detected  that  the  rise  in  temperature 
occurred  during  the  transporting  phase  of  the  cycle.  Temperature  would 
drop  during  the  work  cycle  and  then  rise  again  during  transport.  By 
analysing  the  circuitry,  it  was  determined  that  the  heat,  rise  was  in  all 
probability  due  to  a  restriction  and  further  that  this  restriction  was  lo¬ 
cated  in  the  directional  control  valve. 

In  order  to  substantiate  the  analysis,  the  directional  control  valve 
was  by-passed  and  the  fluid  path  was  controlled  so  that  it  passed  from 
the  pump  directly  to  the  reservoir.  This  resulted  in  a  substantial  re¬ 
duction  in  temperature  and  stabilization  point  in  the  system  thereby 
validating  the  analysis. 

The  problem  of  controlling  the  fluid  temperature  became  twofold: 

(1)  A  method  had  to  be  devised  by  which  vehicles  already  issued  to 
the  field  could  be  modified  quickly  and  economically  and  still  permit 
satisfactory  operation  during  the  service  life  of  the  vehicle,  (Service 
life  is  considered  to  last  from  8  to  11  years  for  this  type  of  equipment. ) 

(2)  Redesign  of  the  hydraulic  system  in  order  to  produce  specification 

changes  which  would  permit  future  procurement  of  »  vnhirl*  of 

satisfying  all  of  the  operational  requirements, 

Prior  to  development  of  a  solution,  it  was  first  necessary  to  estab¬ 
lish  acceptable  operating  parameters.  To  do  this,  the  vehicle  was  in¬ 
strumented  to  record  reservoir  tank  temperature,  pressure  between 
pump  and  directional  control  valve  and  pressure  on  the  return  line  be¬ 
tween  the  control  valve  and  reservoir  tank. 
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Since  the  pump  was  of  a  fixed-displacement  type  directly  coupled  to 
the  engine,  the  controlled  variable  became  engine  speed.  The  pump  ouU 
put  in  gallons  per  minute  was  determined  at  various  engine  speeds.  After 
this,  the  back  pressure  in  pounds  per  square  inch  at  various  flow  rates 
(gpm)  was  determined  for  the  directional  control  valve.  The  next  step 
was  to  determine  the  acceptable  back  pressure  and  relative  temperature 
rise  limits.  This  was  necessary  since  it  already  had  been  determined 
that  300  deg,  temperature  rise  above  ambient  could  be  tolerated  for  the 
particular  oil  being  used  in  the  system  and  for  areas  of  the  world  where 
the  vehicle  would  be  used,  In  order  to  ascertain,  therefore,  what  back¬ 
pressure  could  be  tolerated  which  would  result  in  no  more  than  100  deg. 
temperature  rise,  the  following  tests  were  conducted: 

The  vehicle  was  operated  at  maximum  engine  speed  until  the  temper¬ 
ature  in  the  tank  stabilized  for  a  minimum  period  of  20  minutes.  Engine  1 
•peed  was  varied  and  successive  runs  at  different  speeds  were  made. 
Through  observation  and  analysis  of  the  stabilized  temperature  and  back 
pressure,  it  was  determlhed  that  the  naximum  open  center  pressure  drops 
across  the  directional  control  valve  should  not  exceed  100  peig. 

In  explanation  of  the  above  let  me,  at  this  time,  cite  a  few  of  the 
specifics: 

a.  The  majority  of  test  runs  were  made  in  low  gear  and  at  full 
engine  rpm.  This  will  reproduce  all  conditions  anticipated  during  con¬ 
voy  with  the  exception  of  the  cooling  effect  from  a  high  velocity  wind 
passing  by  the  hydraulic  tank.  When  tested  in  high  gear  at  25  mph,  a 
20  degree  drop  in  maximum  temperature  below  that  of  low  gear  was 
obeerved. 

b.  Pump  specifications  required  a  minimum  oil  viscosity  of  45  8SU. 
For  the  oil  used  in  the  system  45  SSU  occurred  at  200  F . 

c.  All  convoy  runs  wore  made  with  the  engine  side  panels  off. 

When  the  engine  side  panels  were  in  place,  the  result  was  additional 

drop  in  stabilization  temperature  of  24  F. 

d.  An  additional  factor  which,  although  not  measurable,  and  which 
has  a  direct  bearing  on  the  temperature  is  the  nature  of  a  convey. 

Convoys  have  what  is  known  as  an  accordion  effect.  At  high  speeds  on 
long  runs  v  ehicles  have  a  tendency  to  crowd  together.  When  this 
happenB,  the  line  has  to  slow  down  and  vehicles  separate  in  order  to 
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maintain  proper  spacing  between  them.  When  the  fork  lifvt  truck  slows 
down,  engine  speed  decreases.  The  pump  will  circulate  fluid  at  a  lower 
rate  and  the  oil  will  cool. 

These  factors  just  listed  will  permit  safe  operation  in  ambient 
temperatures  up  to  125  F  when  the  temperature  rise  measured  in  the 
hydraulic  tank  with  the  transmission  in  lowest  gear  and  engine  at  maxi¬ 
mum  governed  speed  is  limited  to  100  F. 

While  temperature  could  be  used  as  the  criterion  to  control  the  heat 
rise  in  the  system,  it  is  still  necessary  to  provide  the  manufacturer  with 
some  guide  for  the  selection  of  the  components.  Since  it  had  been 
determined  that  temperature  rise  could  be  controlled  by  controlling  the 
pressure  drop  across  the  main  control  valve,  it  became  necessary  to 
provide  a  tolerance  for  this  factor.  Analysis  of  the  data  indicated  that 
the  maximum  allowable  pressure  which  would  maintain  the  100  degree 
rise  in  hydraulic  tank  was  100  psig.  This  additional  information  would 
control  the  maximum  amount  of  restriction  which  could  be  tolerated  In 
the  main  control  valve. 

The  limitations  placed  on  temperature  and  pressure  would  suffice 
for  specification  requirements,  However,  it  was  still  necessary  to- modi  - 
fy  the  equipment  already  issued  to  the  field. 

While  there  are  many  possible  solutions  to  correcting  the  deficiency 
in  the  equipment,  cnly  four  approaches  were  tested.  These  were? 

a.  Redesign  of  the  hydraulic  tank,  As  previously  stated,  space  was 
at  a  premium,  therefore  little  could  be  done  in  thi  s  area  of  increasing 
the  reservoir  volume.  However,  it  was  possible  to  redesign  the  tank  so 
that  the  flow  of  fluid  from  discharge  to  suction  would  be  along  the  tfcnk 
walls  thereby  taking  maximum  advantage  of  surface  radiation.  While 
there  was  a  temperature  reduction,  it  was  not  of  significant  magnitude 
by  itself  to  control  temperature  rise, 

b,  Control  the  flow  into  the  directional  control  valve.  By  dividing 
the  fluid  as  it  was  delivered  from  the  pump  it  was  possible  to  control  the 
amount  of  fluid  delivered  to  the  valve.  Excess  fluid  could  be  shunted 
directly  to  the  reservoir  tank.  By  controlling  the  amount  of  fluid  which 
passed  through  the  control  valve  it  was  possible  to  control  back  pressure, 
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c.  Replace  the  hydraulic  pump.  By  varying  engine  speed,  it  was 
possible  to  control  the  amount  of  fluid  into  the  directional  control  valve. 
However,  at  a  point  where  back  pressure  was  reduced  sufficiently  and 
temperature  stabilized  within  acceptable  limits,  engine  speed  was  re~ 
duced  to  the  point  where  other  characteristics  were  affected  materially 
enough  to  render  the  vehicle  not  operationally  suitable.  The  effect, 
hydraulically,  could  be  achieved  by  replacing  the  pump  with  one  having 
smaller  delivery  rates. 

d.  Replace  the  directional  control  valve.  This  is  the  most  obvious 
of  those  listed.  Since  the  valve  was  the  cause  of  heat  by  having  internal 
porting  such  that  flow  was  being  restricted,  it  could  be  replaced  with 
another  model  which  had  larger  porting  with  decreased  restriction. 

It  should  be  mentioned  that  there  are  various  combinations  of  the 
four  listed  which  could  also  offer  satisfactory  solutions.  Each  of  the 
four  solutions  has  disadvantages  and  by  themselves  do  not  offer  the  ideal 
solution.  When  certain  combinations  are  made  the  disadvantages  of  each 
by  itself  are  often  nullified.  9 

Since  a  number  of  vehicles  had  already  been  issued,  otheir  factors 
had  to  bs  taken  into  consideration  and  trade-offs  had  to  be  made  before 
the  final  solution  was  agresd  upon,  Some  of  the  factora  wares 

a.  Economy:  The  pumps  and  directional  control  valves  are  costly 
units  in  the  price  range  upwards  of  $300  each.  Installation  costs  for 
directional  controls  would  be  high  as  it  required  extensive  repiping, 

b.  Parts  availability:  The  parts  required  for  the  item  would  have  to 
be  available  within  a  reasonable  time  frame  since  operation  of  these 
vehicles  affected  our  combat  readiness. 

c.  Labor  availability;  The  skills  required  to  apply  the  remedy  would 
have  to  be  available  at  the  level  at  which  the  actual  work  would  be  done. 

■J  Le  J  S.M  ill.. 

\i  •  »'  A  WUWt  WW  *  V,  AAMXA  tw  MW  f  Vli  llV  M  to 

desired  echelon  which  would  apply  remedy.  The  world  wide  dispersion  of 
vehicles  dictated  that  the  remedy  should  be  applied  at  the  lowest  possible 
echelon  in  order  to  avoid  massive  transportation  costs  to  any  single  lo¬ 
cation.  Therefore,  if  the  remedy  could  be  readily  applied  without  the 
need  of  skilled  labor,  the  echelon  would  necessarily  be  a  low  one. 
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e,  Ease  of  maintenance;  This  item  was  a  basic  consideration.  The 
parts  required  to  correct  the  deficiency  could  not  create  an  added  burden 
on  those  responsible  for  the  maintenance  of  the  item. 

Applying  the  factors  just  listed  to  the  possible  solution,  it  was  de¬ 
cided  that  thcji  application  of  a  by -pass  and  flow  divider  type  valve  which 
would  govern  the  flow  from  the  pump  to  directional  control  valve  on  a 
priority  basis  would  satisfy  these  requirements. 

a.  Economy:  The  complete  installation  would  approximate  20%  of 
the  cost  of  installation  of  either  a  new  pump  or  new  directional  control 
valve. 

b.  Parts  availability:  The  item  was  an  off-the-shelf  item  and 
readily  available. 

c.  Labor,  availability;  The  item  could  be  applied  by  an  ordinary 
mechanic, 

d.  Ease  of  installation:  The  unit  could  be  sent  to  the  field  in  kit  form 
and  would  require  only  three  connections. 

e.  Ease  of  maintenance:  The  operation  of  this  valve  is  relatively 
simple  --  fluid  from  the  pump  goes  to  the  inlet  of  the  divider  and  through 
a  fixed  orifice  in  a  sliding  valve.  The  oil  passing  over  the  orifice  creates 
a  pressure  differential  that  pushes  the  valve  against,  a  spring.  Since  the 
spring  exerts  essentially  a  constant  force,  the  pressure  differential  is 
constant  and  the  flow  to  create  the  differential  is  constant.  If  the  flow 
through  the  orifice  tends  to  increase,  the  pressure  differential  ie  in¬ 
creased  and  the  valve  moves  to  uncover  a  by-pass  port.  The  size  of 

the  orifice  may  be  selected  for  any  desired  amount  and  can  be  controlled 
within  one  gallon  per  minute,  Due  to  the  simplicity  of  this  type  valve, 
no  additional  maintenance  burden  would  result  from  its  installation. 

Testing  of  this  valve  against  flic  opci»Uumil  requirement*  indicated 
that  concessions  in  this  area  had  to  be  made  as  follows: 

a.  Engine  speed  had  to  be  governed  down  slightly, 

b.  Back  pressure  up  to  140  psig  would  have  to  be  tolerated  resulting  in 

c.  A  temperature  Hae  up  to  approximately  143  F, 
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As  for  future  procurement,  the  design  of  the  hydraulic  system  has 
been  changed  so  that  a  new  pump  and  directional  control  valve  will  be 
used  which  during  testing  met  the  100  psi  back  pressure  and  100  F 
temperature  rise  limitations. 


PRECISION  OF  SIMULTANEOUS  MEASUREMENT  PROCEDURES 

W,  A,  Thompson,  Jr. 

National  Bureau  of  Standards 
Washington,  D.  C. 

■  J,  ABSTRACT.  We  consider  the  problem  of  measurement  under  the 
following  condition*!  The  process  of  gathering  the  data  is  such  that  on  any- 
given  item  only  one  opportunity  for  measurement  occurs,  but  it  can  be 
observed  simultaneously  by  several  instruments.  The  items  to  be  meaa-  , 
ured  are  variable  so  that  one  cannot  obtain  replicate  observations  with  the 
•ime  instrument  which  would  show,  directly  the  variance  of  the  instrument1 
readings,  Procedures  are  discussed  for  estimating  the  precisions  of  the 
instruments  and  the  variability  of  the  itemB  being  measured. 


•  An  example  due  to  Simon  and  Grubbs  is  helpful  in  fixing  ideas.  The 
burning  times  of  thirty  similar  fuses  are  determined  by  several  different 
observer*.  We  limit  our  discussion  to  the  data  taken  by  observers  A  and 
Cj  hence  there  are  two  determinations  of  the  burning  times  of  thirty  differ  - 
ant  fuses  or  sixty  observations  in  all.  If  each  of  the  fuses  had  the  same  run¬ 
ning  time  (which  is  the  manufacturer's  goal)  and  if  both  of  the  observers 
were  absolutely  accurate,  then  all  sixty  observations  would  be  equal,  How¬ 
ever,  considerable  inequality  in  such  data  always  occurs  due  to  variation  in 
the  manufacturing  process  and  inaccuracy  of  the  observations.  It  then 
becomes  desirable  to  use  the  sixty  observations. to  answer  as  many  ques¬ 
tions  as  possible  about  measurement  bias  and  precision,  mean  fuse  running 
time*  and  variability  of  burning  time*  about  their  mean. 


2.  THE  MODEL,  With  the  verbal  description  of  the  previous  section 
in  mind,  consider  the  following  mathematical  formulation.  Let  x^,  .  .  .  ,x^ 

denote  the  true  values  of  the  items  to  be  measured,  Assume  that  x^,  ,  ,  ,  ,xN 


constitute  a  random  sample  of  size  N  selected  from  a  population  having 
mean  ^  and  variance  c  2  .  Each  of  the  items  in  this  sample  is  then 

measured  by  p  instruments.  yu  is  the  measurement  of  the  1th  item 
(1*1,  ■  •  •  ,  N)  according  to  the  instrument  (j  =  1,  .  .  .  ,p ).  The  consequence 


of  this  measurement  is  that  an  instrumentation  error  e,,,  chosen  at  random 
th  U 

from  the  J  instrument's  population  of  errors,  is  added  to  the  true  value 

of  the  i*k  item! 


y.,  =  x.  +  e 
U  i 


(2.1) 
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The  instrumentation  errors  are  taken  to  be  uneorrelated  among 
themselves  and  also  uneorrelated  with  the  items  selected  for  measure¬ 


ment.  The  mean  and  variance  of  e. 


may  be  called  the  bias  of  the  j*  instrument. 


a xtf2  and  <r  jv 

J  J 


respectively; 


Denoting  the  vector  (y^,  . . . ,  y  )  by  Yi(  we  may  think  of  Yj, , . , ,  Y^ 

as  constituting  a  sample  of  site  N  ■  n+1  from  a  p-variate  distribution 
with  mean  vector  (M  +^t  •  •  /U.+^)  and  dispersion  matrix 


Notice,  in  passing,  that  if  all  instrument  variances  are  equal,  then 
the  model  becomes  a  completely  random  one-way  layout  and  may  be 
analysed  by  the  methods  which  appear,  for  example,  In  Scheffl  15]  . 


A  paragraph  on  notation  will  perhaps  be  helpful.  J*  ,  will  be  used 

as  a  more  succinct  notation  forp.  +0j.  J  "1,  ...,p.  Wi  will  frequently 

write  J  *  (ar  ../)  when  we  mean  that  r  Is  the  element  In  the  j™  row 

thT  JJ  *  Jj^-1  «/ 

and  jf  column  of]p  In  the  same  spirit^  *  (tr  ),  A  ■  (a^/),  and 

S  a  will  be  common  notation!.  Hero 

N  .  ■  ■  : 

(2.3)  *„/  *  &  <vij  -  y-j)  (Vy '-»•/>  . 


and  s,,/  is  the  usual  unbiased  estimate  of  <r  1.  e.  s,./  =  a,,//  n. 

JJ  JJ  JJ  JJ 

3.  POINT  ESTIMATES.  In  [2]  ,  brubbs  recommends  certain 
estimates  of  item  and  instrument  variance,  For  p  *  2  instruments, 
these  estimates  are 
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(3.1) 


2 


12'  V  1  —  S1 1  "  ®12  and  <r  2^“22  -  “12' 
where  ~is  to  be  read  °ia  estimated  byn,  For  p  7  3,  Grubbs  recommends 

2 


2 

<r 


P(P'1) 


2 

j<>j/ 


V 


(3.2) 


’ll 


2 

p-1 


J=2  ‘u.  (p-l)  (p-2)  V 


with  an  analogeous  estimate  of  the  .other  instrument  variances.  Gaylor  pj 
shows  that  Grubbs'  estimate  of  <r  «  is  equivalent  to  a  familiar  variance 
component  estimate.  These  estimates  are  reasonable  in  that  they  have 
the  correct  dimensionality,  are  unbiased,  and  have  appropriate  symmetry 
properties  when  the  instrument  labels  are  interchanged.  Further,  if  the 
underlying  distribution  is  normal,  then  Grubbs'  estimates  are  simple 
functions  of  ths  sufficient  statistics  and  in  the  case  p«2  they  have  a  max¬ 
imum  likelihood  property.  However,  as  Grubbs  has  verbally  pointed  out 
his  estimates  are  unreasonable  in  that  they  frequently  assume  negative 
values  even  though  the  parameters  themselves  must  be  non-negative  by 
their  very  definition. 


For  p=2  this  objectional  characteristic  has  been  .eliminated  in  (jb3  ; 
here  the  altered  estimates  of  table  1  have  been  proposed.  The  top  line 
of  this  table  yielda  the  estimates  (3. 1)  under  conditions  where  they  are 
non-negative.  The  remaining  entries  show  how  Grubbs'  estimate  a  can  be 
modified  when  negativity  would  result  from  using  (3.  1).  These  modified 
estimates  have  Been  derived,  under  normality  assumptions,  from  a  prin¬ 
ciple  of  restricted  maximum  likelihood  which  is  fairly  well  accepted  in 
other  brances  of  statistical  practice,  A  tilda  placed  over  a  parameter  in¬ 
dicates  its  restricted  maximum  likelihood  estimate. 


Table  1.  Non 
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Non-negc 

Conditions 

2 

o- 

flll>S12 

a22>B12>° 

81 2 

°22^ B12>"ll 

flll 

"lls>  *12  >*22 

*22 
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S22  "  *12 


*11  4  *22  '  Z,12 
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4.  RELATIVE  PRECISION.  It  is  clear  that  if  the  instrumentation 
of.  an  experiment , is  to  be  effective  then  the  instruments  must  be  precise 
relative  to  the  variability  of  the  quantity  being  measured.  A  frequently 
quoted  rule  of  thumb  is  that  the  instrument  precision  should  be  an  order 
of  magnitude  greater  than  that  of  the  item  being  measured*  Such  a 
statement  has  no  firm  meaning  unless  a  measure  of  instrument  precision 
and  a  measure  of  item  variability  have  been  agreed  upon.  Here  we  adopt 
~  <r  /r"  as  a  measure  of  the  relative  precision  of  the  first  instrument. 

Then,  for  example',  the  above  mentioned  rule  of  thumb  would  become 

Aj>  10, 

In  the  two-lnatrument  case,  assuming  normality,  we  may  use  a  result 
of  Roy  and  Rose  [3]  to  make  Inferential  statements  of  a  statistical  nature 
concerning  the  parameter  In  our  terminology  their  result  states  that 


has  the  t* distribution  with  n  -  1  d 
Noting  that  ■  (l  +^2)-1 

is  less  than  if  and  only  If  * 


.  f.  where  A  «*  *^*22  ’ 


,  we  may  verify  that  the  quantity  (4. 1) 


Hence  if  t^  is  the  upper  C(  percentage  point  of  the  t-  distribution  with 

n-1  d,  f.  then  the  square  root  of  the  right  hand  side  of  (4.  2)  provides  a 
lower  confidence  bound  for  ,  the  confidence  coefficient  being  l-*f. 

The  inequality  (4.2)  call  also  ue  used  for  the  purpose  of  hypothesis  testing 

For  example,  we  may  rejectA  ,  >  10  at  the  significance  level  <%  if  (4.  2)  is 
violated  with  ^  2  _ 


5.  A  SIMULTANEOUS  CONFIDENCE  REGION.  For  some  purposes 
it  may  not  be  enough  to  consider  relative  precision;  we  may  be  interested  in 
the  actual  non-reiative  precisions  and  the  item  variability.  Estimation  of 
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the  parameters  <r  ,  cr  .  .  ,  f  <r  was  discussed  in  section  3/  but  how 

reliable  are  estimates.?  This  question  is  health  with  in  ,  again  under 
assumptions  of  normality. 


In  the  two -instrument  case,  the  probability  is  at  least  1  -  2  that 
the  following  three  relations  hold  simultaneously 

|  9  ‘  *12  K  |  —  M^ *11*22^  ' 


Here  K  and  M  are  to  be  found  in  Table  2  under  the  desired  value  of  2*1. 


Table  2.  The  table  gives  values  at  K  and  U  which 
yield  1  -  2a  confidence  regions  when  used  in  conjunction 
with  the  relations  {3.1), 


2a, 

.01 

.03 

a 

k 

x  - 

a 

3 

00.78 

00.72 

18.79 

10.71 

4 

12.38 

12.33 

4.146 

4,077 

6- 

,3.080 

3.031 

1.726 

1,605 

0 

1.003 

1.380 

.0833 

.0088 

7 

1.120 

1.078 

*6ifw 

.5763 

0 

0.7450 

.7076 

.4816 

.4052 

9 

0.5380 

.8031 

.3483 

.3022 

10 

0.4120 

,3782 

,2761 

.2357 

11 

0.3282 

.2063 

.2230 

.1001 

12 

0.2608 

.2306 

.1032 

.1673 

13 

0.2272 

.1003 

.1068 

.1328 

14 

0.1051 

.1670 

.1484 

>  .1140 

13 

0.1702 

.1438 

.1301 

,00086 

10 

0.1608 

.1281 

.1169 

.03739 

17- 

©,1844 

.1100 

.1060 

.07767 

10 

0.1213 

.00772 

.00632 

.06062 

10 

0.1103 

.08762 

.00004 

.06887 

SO 

0.1008 

,07806 

.08237 

.08718 

22 

.08810 

.00846 

.07162 

.04700 

24 

.07484 

.06638 

.06311 

.04008 

26 

,06608 

.04763 

.08641 

.03654 

20 

,05001 

.04182 

.08096 

.03121 

30 

,08328 

.03660 

.046441 

.00768 

35 

,04278 

.02778 

.03796 

.02127 

40 

.03686 

,02200 

.03800 

.01700 

40 

00 

.03040 

.02082 

,01707 

.01803 

.08771 

.08440 

.01308 

.01170 

00 

.02100 

.OHIO 

.01067 

i 00876 

70 

.01748 

.00868 

*01640 

.00684 

S° 

.01482 

.00604 

.01416- 

.00663 

00 

.01300 

.00575 

.01241 

.00460 

100 

.01182 

.00480 

.01104 

,00890 
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For  more  than  two  instruments  a  similar  result  is  valid,  We  have 
the  following  relations  with  probability  at  least  1  -  2fl£ 


(5.2)  j  m/x  y  l-ajj/  K  ’  M  (aw  a  jV* ) 

jmj[x  j  [(an  ■  au) K  ■  Mlan +  ajj  "Zaij>.  ]  *3 

-£<r  J<  min  ^  [  (*n  -  a^K  +  .M[an  +  Sjj  *  2*^}]  *]_, 

2  2 

plus  p  -  1  similar  inequalities  involving  ff  ^  ,  .  .  .  ,  <r  .  Unfortunately, 

for  p  in  excess  of  two,  tables  of  K  and  M  are  unavailable.  The  only 
result  which  la  currently  ready  for  use  is  an  approximation  valid  for 
large  ns  Choose^  to  satisfy  P(.<  a  1  “  2<*.  wr^ta  &  =  M  =  l/ii 

and  substitute  this  common  value  in  (5.  2).  1  feel  obliged  to  point  out 
that  for  p  =  2,  the  only  case  .where  exact  values  are  available,  this 
approximation  is  rather  poor. 


6.  NUMERICAL  EXAMPLE.  Returning  to  the  fusse  burning  time  „■ 
data,  we  may  identify  observer  A  as  the  first  instrument  and  observer 
C  as  the  second.  From  Table  1  of  Grubbs'  paper  [2]  we  obtain 
au  a  1.3671,  a  =  1.3227,  a  =  1.  3320  and  n  *  29.  From  the  third  '  " 

row  entry  of  our  table  1,  we  estimate  it  =  .  21,  cr  =  .  03  and  or  ^  I 

By  the  method  of  section  4  we  obtain,  for  example,  that  the  relative 
precision  of  observer  C  exceeds  5.  1  with  a  confidence  of  95%. 
Alternatively,  from  a  hypothesis  testing  point  of  view  we  would  reject 
the  rule  of  thumb  requirement,  A  2>  10,  at  the  5%  level.  The  relations 

(5,  1)  and  table  2  yield  the  following  95%  simultaneous  confidence  region: 

.  16*C  <r  .  32,  0  <  0-  <  .  09  and  0 <  o*  ?  <  .  07 .  In  calculating  these 

11  “  • 

simultaneous  confidence  intervals  we  have  replaced  all  negative  lower 
bounds  by  zero.  Notice  that  the  confidence  intervals  bracket  their 
respective  estimates  and  hence,  in  the  confidence  region  sense,  indicate 
the  uncertainty  of  these  estimates. 
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APPLIED  MICROSCOPY 


George  I.  Lavin 
Terminal  Ballistics  Laboratory 
USA  Ballistic  Research  Laboratories 
Aberdeen  Proving  Ground,  Maryland 

'the  Aberdeen  Proving  Ground  in  general  and  the  Ballistic  Research 
Laboratories  in  particular  are  interested  in  the  manner  by  which  absorbed 
energy  is  utilised  by  various  systems.  The  technique  describes  the  possi-  ■ 
bility  of  an  evaluation  of  the  traumatic  effect  brought  about  by  the  absorp¬ 
tion  of  energy  at  the  cellular  level.  ) 

This  paper  (presented,  in  brief,  to  the  Eighth  Conference  on  the 
Design  of  Experiments  in  Army  Research/  Development  and  Testing,  The 
Walter  Reed  Army  Institute  of  Research,  Washington,  D,  C  , ,  October  I96Z) 
has  to  do  with  the  ultraviolet  microscopy  of  biological  tissues. 

There  is  much  controversy  having  to  do  with  the  structure  and  function 
of  biological  cellular  configurations,  This  controversy  will  continue  to  exist 
until  methods  are  employed  for  the  analysis  and  evaluation  of  experimental 
results  which  do  not  (by  preparation  and/or  examination)  change  the  material* 
during  the  evaluation  procedure, 

ii  A  paper  describing  a  photomicrographic  technique  was  published  by 
Kohler  (1)  in  1904,  The  optical  system  was  quart*  instead  of  the  usual  glass. 
The  purpose  of  this  was  to  take  advantage  of  the  Increase  in  resolution  which 
is  realised  When  ultraviolet  light  is  used  as  the  source  of  illumination  instead 
of  the  visible  region  of  the  spectrum. 

The  light  source  employed  by  Kohler  was  a  condensed  electrical  spark 
between  metallic  electrodes.  This  1b  unsatisfactory  for  the  illumination  of 
a  microscope.  The  electrodes  burn  away  non-uniformally  Which  means  that 
it  is  difficult  to  keep  ah  image  of  the  source  centered  on  the  microscope 
condenser.  AIbo  the  noise  of  the  spark  is  objectionable.  In  spite  of  these 
and  other  difficulties,  some  work  has  been  published  (2), 


The  early  workers  were  attracted  to  this  field  because  the  technique 
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resolution  was  about  twice  that  obtained  with  "visible  light)  although  the 
initial  magnification  might  be  low, 
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In  other  words,  the  increase  in  resolution  made  possible  the  vieuali- 
zatiomof  microscopic  structure  which  was  not  evident  until  it  was  revealed 
by  the  enlarging  camera. 

It  is  to  be  pointed  out  that  the  obvious  lack  of  light  intensity  was  due 
to  the  inefficiency  of  the  monochromator  system  used  to  isolate  the, 
wave  length  of  light  (2750A)  for  which  the  objectives  were  corrected. 

It  was  also  realized  that  tissue  components  such  as  proteins,  nucleic 
acids  and  nucleoproteins  have  specific  absorption  bands  in  this  region 
of  the  spectrum  so  that  it  should  be  possible  to  obtain  micrographs  of 
fresh  and  unstained  material. 

Thus,  in  a  sense  of  the  word,  it  can  be  said  that  the  chemical  con* 
•tituenti  of  the  tissue  can  act  as  their  own  specific  light  absorbing 
medium  --the  stain. 

It  is  well  understood  that  the  fixation  process  (necessary  for  the 
manipulation  of  tissue  cutting)  may  contribute  to  the  micrograph! cal 
picture.  We  do  not  always  know  what  contribution  this  represent*  to  our 
over -all  picture.  By  means  of  frozen  sections  we  can  minimlae  this  un¬ 
certainty.  We  will  also  need  the  frozen  section-type  of  section  for  our 
analytical  procedures. 

Ths  inherent  objection  to  previous  procedures  was  that  it  was  not 
possible  to  obtain  sufficient  light  intensity  of  the  proper  wave  length 
(in  the  plane  of  the  photographic  plate)  so  that  a  field  and  focus  could 
be  localized  and  imaged  with  the  wave  length  of  light  which  is  specifically 
absorbed  by  the  msterial  under  examination. 

In  some,  cases,  a  fluorescent  plate  was  placed  directly  oner  the  micro¬ 
scope  eyepiece,  Thus  another  adjustment  had  to  be  made  in  order  to 
bring  the  image  in  focus  in  the  same  plane  of  the  photographic  plate. 

In  other  words,  the  focus  must  be  in  the  plane  of  the  photographic  plate,,, 

In  1943  a  short  paper  on  the  subject  of  ultraviolet  microscopy  was 
oublished  by  Ltvin A  nmn^Airp  wh*re)?y  an  imij?  ol 

the  material  on  the  stage  of  a  microscope  could  be  visualized  by  a 
fluorescent  screen  which  was  temporarily  placed  in  the  position  usually 
occupied  by  a  photographic  plate.  That  is,  in  the  plate  holder. 
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The  2537  Angstrom  mercury  line  was  the  light  source  (loc,  cit, ).  It 
has  been  previously  pointed  out  that  this  wave  length  of  light  is  in  the 
region  of  absorption  of  those  chemical  compounds  which  are  to  be  asso¬ 
ciated  with  tissue^structure. 

The  photographs  which  are  now  shown  will  serve  to  illustrate  this 
technique  and  some  of  the  results  obtained  by  application  of  this  proce¬ 
dure.  The  original  plates  were  taken  at  a  magnification  of  about  200 
diameters. 

DESCRIPTION  OF  PLATES 

1.  Ultraviolet  photomicrographic  apparatus  described  by  Kohler. 

Note  the  spark  source,  the  monochromator  and  the  eyepiece  focusing 
attachment. 

2.  Apparatus  used  in  the  present  work.  Light  source,  liquid  filter, 
willemite  focusing  screen. 

3.  Light  source  --  quartz  resonance  radiation  lamp. 

4.  Spectrum  of  light  source,  with  and  without  filter, 

5.  Fresh  Hamster  muscle  --  teased  out  (not  cut),  fresh,  unstained. 

6.  Muscular  dystrophy  --  cross  section. 

7.  Muscular  dystrophy  --  longitudinal. 

8.  Fresh  smear  of  cells  from  a  chicken  egg, 

9.  Liver,  normal  --  fixed,  unstained, 

10.  liver,  infectious  hepatitis,  fixed,  unstained.  ■ 

11.  Cross  section  of  a  plant  root  (Sorrell),  unstained, 

12.  cross  section,  skin  (mai  del  pinta),  unstained. 

13.  Salivary  gland  of  a  mosquito,  fresh  —  unfixed,  unstained. 

14.  Enlargement  of  a  portion  of  the  salivary  gland  shown  above. 
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13.  Kidney,  cross  section  --  unstained. 

16,  Red  cells,  smear,  monkey,  dried, 

17.  Red  cells,  smear,  chicken,  dried,  showing  nuclei. 

18,  Arbacia  eggs,  showing  the  "relayering"  on  rupture, 

19,  Arbacia  eggs,  showing  the  results  of  photography  in  the  visible, 
ultraviolet  and  infrared  regions  of  the  spectrum. 

20.  Muscle  photographed  using  the  2537  A°  mercury  line,  unstained, 
visible  --  stained,  dedicated, 

21,  Absorption  spectrum  curve  of  1,  2  --  Benzanthracene, 

22.  Absorption  spectrum  of  the  same  substance  using  the  continuous 
light  from  a  hydrogen  discharge  tube  as  the  light  source; 

23.  Apparatus  for  photomicroscopy  --  three  light  sources,  infrared* 
visible,  ultraviolet. 


THE  USE  OF  CONTINUUM  AS  A  UOHT  SOURCE  FOR  ABSORPTION 
SPECTRA,  As  has  been  pointed  out  those  compounds  Such  ait  proteins 
nucleic  acids,  nucleoprotelns  etc,  have  broad  absorption  bands  when 
measured  by  spectrophotometers, 

It  has  also  been  shown  by  Lavin  and  NorthrojJ^'  and  other!  that  a 
considerable  amount  of  band  structure  can  be  demonstrated  (at  room 
temperature)  by  the  use  of  a  spectrograph  of  comparative  low  dispersion, 
It  was  also  indicated  that  these  bande  can  be  interpreted  in  terms  of 
the  component  parts  of  the  molecule  by  Lavin,  Loring  and  Stanley'1 
Thie  technique  has  also  been  applied  to  compUcated  mixture ■  (body 
fluids)  by  Dobriner,  Lavin,  and  Rhoads'®  “ 

Phntnoranhn  iltnitpaHna  thn  a  hnvp  a  r„  >hn«m  in  Plain  22.  Tfc  in 

thought  that  efforts  to  apply  this  technique  itu  obtaining  the  absorption 
spectra  of  materials  on  the  stage  of  a  microscope  might  be  worthwhile. 
This  could  be  a  clue  to  the  chemical  composition  of  the  various  sections 
of  material  under  examination. 
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SUMMARY.  Photomicrographs  of  fresh  and  of  unstained  tissues  ob¬ 
tained  with  the  2537  A°  mercury  line  as  the  light  source  are  shown  and 
some  of  the  implications  of  this  technique  are  discussed. 

-■  it 

The  possibility  of  a  microspectrographic  application  to  the  problem 
is  considered, 
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REDUNDANCIES  IN  HUMAN  BIOMECHANICS  AND  THEIR  APPLICATION 
IN  ASSESSING  MILITARY  MAN-TASK  DISABILITY  PERFORMANCE 
RESULTING  FROM  BA LLISTIC  AGENTS 

William  H.  Kirby,  Jr, 

Ballistic  Research  Laboratories  " 

ABSTRACT,  Nervous  system  redundancies  have  a  counterpart  in 
human  biomechanics  which  are  evident  when  analyzing  man-task  perfor¬ 
mance  using  simulations  of  functional  disabilities,  These  multiple  choice 
pathways  available  for  task  accomplishment  could  explain  some  of  the 
surprisingly  small  drops  in  performance  in  the  presence  of  otherwise 
significant  tissue  trauma  especially  in  cases  of  highly  motivated  soldiers, 
Such  findings  are  thought  to  be  useful  in  a  bioengineering  approach  for 
optimizing  man-machine  or  man-task  relationships  and  deriving  technical 
rules  for  the  design  of  body  armor  and  protective  clothing  for  minimizing 
personal  injury  from  ballistic  agents, 

■  •  "-'i 

INTRODUCTION.  This  is  a  discussion  concerning  a  problem  which 
associates  engineering  and  medicine  in  a  military  context.  As  such  it  is 
a  cross rapplication  of  exact  and  Inexact  sciences,  With  the  advent  of 
more  intensive  interest  in  mathematical  applications  to  biological  prob¬ 
lems  and  the  maturation  of  systems  analysis,  one  now  has  more  formid¬ 
able  tools  with  which  to  attack  such  problems.  However,  this  discussion 
is  restricted  to  an  identification  of  the  natural  conditions  allowing  for 
multiple  choice  pathways  in  task  accomplishment.  No  mathematical 
model  is  proposed, 

Engineering  and  mathematical  applications  to  systems  behavior, 
particularly  "living-systems",  have  brought  about  many  new  ideas  re¬ 
garding  complex  problem  analysis.  An  effect  of  this  has  been  and  is, 
increasingly,  that  of  providing  us  with  more  understanding  of  the  nature 
of  these  systems,  This  encourages  us  to  go  bank  to  our  natural  systems 
for  re -examination  but  with  more  enlightenment  on  what  wo  are  really 
looking  for. 

This  morning  attention  is  directed  to  the  response  at  complex  living 
systems,  specifically,  humans,  under  a  very  largfe  spectrum  of  traumatic 
or  wounded  states.  Such  interactions  are  of  interest  In  a  setting  of 
military  stress  situations,  Furthermore,  it  is  important  to  correlate 
these  responses  with  performance  associated  with  defined  tasks  (or 
military  occupational  specialties)  as  they  appear  in  tfte  various  tactical 
roles. 
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In  our  first  approximations,  we  assume  the  presence  of  sufficiently 
high  motivation  such  that  if,  despite  the  presence  of  trauma,  a  human 
biomechanical  capability  to  perform  in  any  fashion  exists,  it  will  be 
used.  Consideration  today  will  be  restricted  to  qualitative  structure- 
function  relationships  and  useful  methods  of  analysis,  There  is  signi¬ 
ficant  starting  data  relating  to  gross  mechanisms  for  uninjured  human 
function  in  terms  of  anatomical  and  physiological  knowledge,  One  use¬ 
ful  approach  to  this  kind  of  problem  is  the  use  of  simulation  procedures 
and  gaming,  This  could  give  us  some  idea  of  the  value  of  a  loss  of  funct¬ 
ion  regardless  of  cause,  Obviously  wounds  cannot  be  directly  simulated, 
but  many  endpoint  effects  in  terms  of  functional  disabilities  can  be,  Finally 
another  essential  is  the  ability  to  study  man-task  interactions  as  they 
relate  to  accepted  performance  levels.  In  this  respect  Industrial  en¬ 
gineers,  uirgunumisls,  and  applied  experimental  psychologists  are  s- 
volving  much  useful  information. 

DISCUSSION.  Ballistic  agents  directed  at  potential  enemy  soldiers 
are  assessed  in  terms  of  the  incapacitating  effects  which  they  bring 
about.  A  wound  per  se  may  have  little  meaning  ill  a  military  stress 
situation  unless  it  is  matched  against  task  requirements,  Incapacitation 
is  defined  in  this  frame  of  reference  as  the  "diminished  capability  to 
perform  a  defined  task.  "  Specifically,  a  wounded  enemy  soldier  may 
have  an  otherwise  serious  wound  in  an  upper  limb,  but  should  his  task 
(military  occupational  specialty),  require  the  use  of  only  one  limb  to 
handle  his  weapon  or  machine  for  counter  use  during  the  stress  en¬ 
gagement,  and  thereby  effectively  incapacitate  his  enemy  (us),  then  the 
incapacitating  effect  of  our  ballistic  agent  is  not  great.  It  may  not  even 
be  significant.  Of  course,  the  converse  may  be  true.  A  small  but 
deeply  penetrating  wound  may  be  very  incapacitating.  An  example  of 
the  latter  could  be  one  in  ivhich  a  soldier  is  required  to  have  extremely 
fine  motor  coordination  in  both  limbs  simultaneously  in  order  to  perform 
the  task  adequately,  In  this  case,  quite  a  large  variety  of  small  penetrating 
wounds  at  various  anatomical  locations  could  be  cited  in  which  motor 
(muscle)  control  would  be  lost  resulting  in  either  an  inability  to  control 
fine  movement  or  an  inability  to  manipulate  the  entire  limb  Into  position 
for  accomplishing  the  tine  movement.  The  point,  ot  course,  in  this 
definition  of  incapacitation  IS  the  fact  that  an  evaluation  concerns,  not 
man  alone,  but  man  coupled  to  his  assigned  tasks  in  prescribed  environ¬ 
ments. 

As  physicians  we  think  in  terms  of  pathological  mechanisms  per- 
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from  the  basic  medical  sciences.  Functional  disabilities  ascribable  to 
any  spectrum  of  injuries  are  assumed  to  be  variable  and  time  dependent. 
Functional  deficits  are  related  in  this  human  system  analysis  to  the  final 
common  motor  pathway  which  is  a  clinical  way  of  referring  to  one's  re¬ 
active  muscle  mechanics,  This  applied  concept  is  usefbl  inasmuch  as 
the  interlock  existing  between  man  and  his  external  physical  mission  or 
mechanical  work  is  to  be  accomplished  is  one  of  dynamic  character.  At 
times  this  interlocking  dynamics  is  characterized  by  numerous  physical 
actions  while  at  other  times,  such  actions  are  numerically  minimal  but 
the  physiological  requirements  are  intense.  In  any  event,  it  is  obvious 
that  in  studying  human  actions  we  must  deal  with  a  complex  integration 

of  both  physical  and  physiological  factors, 

A ■  engineers  we  express  work  in  terms  of  force  times  distance, 
Physiologically  we  have  often  considered  work  bn  the  part  of  a  living 
system  as  an  expenditure  Of  metabolic  energy.  In  this  sense  we  are,  of 
1  couree,  in  error  in  our  definition  of  work.  We  need  to  differentiate 

between  metabolic  energy  utilized  for  life  support  or  maintenance  of 
f-  hamoostatis  and  that  metabolic  energy  available  and  employed  to  accom- 

\  plish  "useful"  external  work,  In  engineering  we  sometimes  use  the 

expression  "useful  work"  when  discussing  thermal  efficiency  of  *  machine, 

For  example,  the  thermal  efficiency  of  a  locomotive  may  be  8  per-cent, 
meaning  that  8  per  cent,  of  the  available  energy  is  converted  to  so  many 
foot-pounds  of  output  and  the  remainder  to  heat.  However,  in  handling 
the  combination  of  inanimate  and  animate  (man  and  weapon),  some 
■  practical  criteria  for  NORMAL  man-task  behavior  are  needed  against 
which  one  can  aasess  performance  for  incapacitated  states. 

In  our  first  approximations,  it  appears  practical  to  use  a  qualitative 
form  of  biomechanics  providing  we  can  correlate  this  satisfactorily  with 
appropriate  performance  levels  an  derived  from  experimental  analysis, 
Anthropometrieal,  physiological,  and  psychological  variations  in  the  human 
are,  of  course,  an  integral  part  of  any  appraisal  of  human  function  and 
behavior  in  the  final  analysis,  Hopefully  one  looks  forward  to  maths-  j 

matical  expressions  for  causal  relations  that  are  valid  and  reliable,  j 

Man  is  endowed  with  considerable  versatility,  The  use  of  this  ver¬ 
satility  is  influenced  by  the  mind  (brain),  body,  and  environment.  The 
need  to  relate  wound  tract  pathology  with  the  internal  biomechanics  of 
body  actions  is  apparent.  However,  we  also  find  it  useful  to  study  over¬ 
all  functional  behavior  while  in  action  in  order  to  get  impressions  of  the 
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sequential  dynamics  that  differentiate  one  kind  of  task  from  another,  These 
applied  human  mechanics  can  be  studied  in  terms  of  their  mechanistic 
factors  ...  i.  e.  ,  bone -muscle  function.  In  the  long  run  our  model  must 
include  input  factors  such  as  sensing  and/or  kinesthetic  items  as  well  as 
kinematics,  time-varying  factors  such  as  endurance  and  fatigue,  and 
system  alterations  due  to  environment  in  this  total  biological-task- 
environmental  stress  system  problem. 

The  biophysics  and  pathological  dynamics  of  wounding  are  matters  of 
great, importance  but  beyond  our  scope  this  morning.  We  will  attempt  here 
to  explore  the  problem  in  reverse.  We  may  begin  with  certain  functional 
(motor)  deficits  which  could  conceivably  be  derived  from  one  or  more 
wounds,  In  the  future  we  expect  to  assess  other  factors  in  the  human 
circuitry  such  as  loss  of  sensory  function,  kinesthetic  changes,  and 
trauma  to  the  body  subsystems  such  as  the  nervous  system,  cardio¬ 
vascular  system,  and  respiratory  system.  We  hope  to  be  able  to  draw 
from  others  doing  human  research  in  the  Ufa  sciences  and  biotechnology. 

As  mentioned,  we  will  try  to  relate  traumatic  effects  to  that  final  common 
motor  pathway.  By  simulating  motor  deficits  we  are,  in  effect,  working 
backwards.  The  more  general  motor  deficits  are  not  difficult  to  simu¬ 
late  and  as  such  enable  us  to  make  at  least  first  approximations  of  man- 
task  (soldier -weapon  or  soldier-task)  performance  behavior  as  this  occurs 
in  simulated  tactical  role  exercises.  Incidentially,  it  is  felt  that  this 
approach  will  allow  us  to  do  as  Professor  Pearson  outlined  yesterday  . . . 

, .  .  weld  together  the  important  elements  Including  mathematical  and  war 
And  computer  games  on  the  one  hand  and  laboratory  experiments,  range 
trials,  and  Army  exercises  on  the  other.  :  ? 

Our  view  of  a  human-task  model  Includes  the  following  factors: 

1.  The  Human  or  Living  Machine 

2.  Tasks 

3.  Interactions  of  the  Living  Machine  and  Teak 

Accomplishment  „ 

4.  Environment  (not  discussed  in  this  paper) 

The  Human  or  Living  Machine, 

In  our  present  work,  the  human  body  is  being  considered  as  a  living 
machine  endowed  with  a  natural  structural  system  capable  of  serving  its 
internal  biological  needs  while  performing  external  tasks.  Many  sources 
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are  available  for  descriptions  of  human  mechanics.  The  Hall  of  Biology 
of  Man  of  the  American  Museum,  of  Natural  History  is  one  of  these. 
Anatomists,  particularly  J.  C.  Grant  (A  Method  o  £  A  nn  to  my )  andG.  B. 
Duchenna  (The  Physiology  of  Motion,  more  recently  translated  by  £.  B. 
Kaplan  of  Columbia  University),  offer  very  detailed  work  along  these 
lines.  Your  attention  may  have  been  attracted  recently  to  the  present 
aeries  of  articles  in  LIFE  Magazine  which  discusses  some  of  the  bio¬ 
mechanics  of  the  human  body. 

While  many  people  have  not  thought  about  human  function  in  terms 
of  mechanics,  they  are  not  particularly  surprized  when  human  activity 
is  conservatively  compared  with  mechanical  device*.  It  is  also  not 
difficult  to  see  that  some  overlap  or  redundancy  must  exist  in  a  system 
in  which  the  parts  are  so  intricately  intertwined  as  in  the  human. 

Studies  of  normal  (non-injured)  human  subjects  performing  given  tasks 
show  that  different  people  use  different  methods  in  performing  them. 

In  addition,  these  methods  are  modified  as  subjects  become  more 
accustomed  to  the  tasks.  We  say  that  workers  become  conditioned  or 
skilled  in  their  tasks.  Handicapped  workers  are  often  forced  to  use 
even  radically  different  methods.  In  the  few  simulated  incapacitation 
studies  that  we  have  made,  we  have  found  a  considerable  variety  of 
methods  employed  by  our  limited  number  of  subjects,  In  a  real  sense, 
then,  we  can  consider  this  multiplicity  of  methods  in  terms  of  bio¬ 
mechanical  redundancies.  As  a  matter  of  fact,  one  can  often  explain 
(he  adaptation  or  describe  the  compensatory  pathway  chosen  on  the  part 
of  a  disabled  individual  when  a  more  natural  one  is  not  available  for  per¬ 
forming  a  given  task. 


Turning  briefly  to  the  applied  or  task  side  of  the  picture,  i,  a.  ,  the 
nature  of  the  things  that  impose  motor  output  requirements  on  the  human 
machine,  We  find  an  almost  endless  array  of  situations.  Knobs  have  to 
be  grasped,  turned,  and  released;  levers  (such  as  rifle  trigger,  bolt, 
otc. )  have  to  be  pulled  and  pushed;  things  have  to  be  grasped,  raised, 
lowered  and  released;  buttons  have  to  be  pushed,  tools  have  to  be  handled, 
vehicles  guided,  etc.  All  such  physical  tasks  may  be  arbitrarily  viewed 
as  being  accomplished  by  composites  of  elementary  actions  performed  by 
the  human  (machine). 
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Interactions  of  the  Laving  Machine  and  Physical  Tasks. 

Viewing  the  human  machine  in  action  shows  a  link -linkage  system 
including  its  affixed  but  integrated  motors  which  raise  and  lower  limbs 
(for  walking,  lifting  objects,  et/c. ),  raise,  lower,  turn,  and  tilt  the  head, 
etc.  Identification  of  these  muscle-motor  systems,  their  sequence(s), 
and  associated  force  factors  can  be. studied  extensively.  Muscle  and 
joint  functions  are  quite  well  known.  Their  motion  and  force  vectors 
can  be  studied.  The  kinematic  processes  activated  by  the  human  motors 
can  be  at  least  approximated  by  various  methods  and  are  very  informative 
from  both  qualitative  and  quantitative  points  of  view.  Data  are  being 
generated  in  many  of  the  associated  sciences  involved  in  the  type  of 
cross-application  presented  here,  and, the  ways  and  means  are  evolving 
rapidly  for  handling  such  massive  bits  and  pieces  of  acquired  information. 
The  need  for  the  systems  analysis  has  already  been  mentioned.  Infor¬ 
mation  handling,  cybernetic  modeling  using  acceptable  analogs,  computer 
technology,  statistical  and  adaptive  control  techniques  are  included  in 
the  knowledge  sources  useful  in  understanding  complex  system  behavior. 

Today  I  would  like  to  call  attention  to  a  very  crude  experiment  which 
indicates  the  multiplicity  of  motor  pathways  available  to  the  human  in  per¬ 
forming  given  tasks.  Variations  in  weapon  design,  man-task  functional 
modes,  objective  definitions,  parameters  and  boundary  conditions  have 
not  been  specified  from  a  systems  viewpoint.  We  have  used  very  simple 
immobilisation  techniques  for  inhibiting  certain  motor  functions  in  order 
to  enforce  and  observe  the  use  of  alternative  motor  pathways.  This 
experimental  exercise  has  to  do  with  rifle  firing  and  reloading.  The 
target  is  about  2  feet  by  2  feet  at  a  distance  of  approximately  40  yardit 
on  a  flat  terrain.  One  of  the  first  questions  of  interest  to  us  was,  "Can 
one  perform  under  functional  disability  conditions,  rather  than  how  well"? 
However,  as  you  will  see  from  the  film,  we  get  cues  as  to  how  well  one 
does  and  can  perform. 

In  order  to  be  a  little  more  inclusive,  the  rifle  experiment  wee  run 
using  two  different  weapons,  namely,  the  U,  S,  M-14  and  the  Russian 
AK  both  of  which  are  standard  items.  We  will  not  speculate  on  weapon 
differences  as  such,  but  we  will  mention  a  few  things  about  a  man- 
rifle  relationship  with  and  without  functional  losses.  You  will  observe 
in  the  film  that  a  soldier  can  fire  his  weapon  quite  effectively  in  all  firing 
positions  without  either  upper  limb.  Pistol  grips  and  monopods  seem  to 
be  quite  helpful  to  a  soldier  so  disabled.  Now  let  us  view  the  film. 
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A  MAN-TASK  DISABILITY  EXERCISE:  RIFLE  FIRING.  Time  will 
allow  for  only  a  few  general  remarks,  1  would  like  to  say  that  the  more 
one  reviews  and  studies  motion  pictures  of  man-task  behavior  the  more 
one  can  comprehend  the  biomechanics  taking  place  in  such  exercises. 

The  anatomist  may  be  the  first  to  observe  the  variations  in  anatomical 
mechanics;  the  statistician  may  quickly  detect  probabilities  in  terms  of 
cause  and  effect  relationships;  the  abstract  mathematician  may  see  early 
cues  for  a  stochastic  model;  the  mechanical  engineer  may  be  the  first  to 
note  the  vectorial  mechanics  in  3-dimensional  space;  the  physiologist 
may  immediately  observe  the  abrupt  discontinuities  in  the  human  functional 
activities  and  feel  more  sensitive  about  the  corresponding  metabolic  re¬ 
quirements  involved;  etc. 

At  this  time,  we  have  no  valid  Statistical  data.  In  our  very  crude 
investigation,  we  have  observed  with  caution,  of  course,  the  following; 

1.  Partial  losses  up  to  and  Including  either  total  limb  did  not 
prevent  the  subjects  from  firing  and  maneuvering. 

2.  Target  scores  did  not  decrease  much  below  the  65%  -  75% 
accuracy  range  even  for  the  most  severe  simulated  disability  that  we 
employed  .  .  .  the  inability  to  use  the  trigger  arm. 

3.  Firing  rates  and  reload  times  were  only  a  few  seconds  longer 
in  the  absence  of  a  total  upper  limb. 

4.  The  motions  exhibited  by  the  subjects  are  somewhat  influenced 

by  si ee,  shape,  and  weight  characteristics  of  the.  weapons.  However, 
required  body. position*. .standing,  prone,  etc.  .  ,  .  naturally  influ¬ 
ence  the  biomechanical  adjustments  which  must  take  place.  » 

MOTION  STUDY  OF  HUMAN  ACTION.  Since  human  work  Is  accom¬ 
plished  by  means  of  body  actions,  the  study  of  body  movements  has  evolved 
as  one  of  the  principal  approaches  to  the  problem  of  finding  more  effective 
ways  of  performing  tasks.  From  such  empirical  studies,  rules  have  been 
developed  which  are  available  for  more  effective  application  in  planning 
and  designing  tasks,  machines,  and  weapons.  Skillful  application  of 
these  principles  diminishes  fatigue.  It  is  interesting  but,  perhaps,  not 
surprising  that  the  methodology  proposed  for  the  study  of  incapacitation 
i.  e. ,  functional  deficit  simulation,  is  usefol  in  studying  normal  man- 
task  phenomena. 
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In  recent  years,  physicians,  applied  experimental  psychologists, 
physiologists,  and  engineers  have  been  studying  performance  factors 
and  have  developed  considerable  empirical  data  especially  in  regard  to 
environmental  perception  and  functional  response.  Others  giving  much 
thought  to  human  anatomical  function  include  (in  addition  to  anatomists) 
orthopedists,  physical  therapists,  and  designers  of  prostheses,  Functional 
anthropologists,  physicists  and  advanced  systems  engineers  are  also 
becoming  essential  participants  in  this  area  of  activity.  However  ,  we 
have  hot  fully  recognized  the  capabilities  of  these  professions  in  cross¬ 
discipline  or  cross-professional  applications.  A  sizeable  effort  has  been 
directed  in  more  recent  years,  to  a  so-called  ergonomic  approach  to 
mawrtask  analysis  especially  in  Europe,  This  approach  places  more 
emphasis  on  the  integration  of  anatomy,  psychology  and  physiology  as 
well  as  economics  for  Solving  problems  inhuman  performance. 


The  Gilbreths,  pioneers  in  the  development  of  human  motion  principles, 
devised  a  list  of  17  so-called  "elements"  or  "therbligs"  as  they  have  been, 
called.  Such  elements  have  been  considered  as  basic  units  of  motion  and 
apply  for  the  most  part  to  the  upper  limb  functions.  They  include  such 
terms  as  ''transport  empty"  meaning  moving  the  hand  from  one  position  at 
a  work  place  to  another  in  that  vicinity;  "transport  loaded"  meaning  the 
same  lining  except  that  the  hand  is  now  carrying  an  object  in  which  case  the 
characteristics  of  the  object  are  specified;  "grasp"  meaning  a  securing 
of  an  item  either  by  a  pinch* grasp  performed  by  the  fingers  or  a  palmar- 
grasp  as  performed  by  enclosing  the  hand  about  the  item;  "hold"  meaning 
that  the  hand  in  question  is  maintaining  an  object  in  a  fixed  position  while, 
perhaps,  the  opposite  hand  ii  doing  something  to  the  object  as  may  occur 
in  an  assembly  operation;  etc.  In  each  case,  the  elements  are  timed. 
Therbligs  are  usually  measured  to  one -thousandth  of  a  minute.  Stop¬ 
watch  time  and  motion  study  engineers  usually  measure  their  elements, 
in  terms  of  one-hundredth  of  a  minute.  Instead  of  using  therbligs,  they 
use  descriptive  terms  which  are  more  general,  such  as  "pick  up  hammar", 
"tap  dowel  to  flush  position",  "place  hammar  aside",  "place  assembly  in 
tote  box",  and  "measure  outside  diameter  with  micrometer",  As  long  as  the 
the  ^notions  are  defined  and  measured  consistently,  they  are  useful  in  the 
analysis  and  the  synthesis  of  operations. 

Very  quickly  I  would  like  to  show  you  the  motion  study  and  analysis 
technique  for  a  given  operation  which  is  described  on  the  following  slides 
(figures).  Our  slides  show  several  motion  study  charts  based  on  a  hy¬ 
pothetical  exercise.  In  slide  1  (Figure  1)  we  show  a  "Right-hand;  Left- 
hand  Chart"  and  for  simplicity  only  the  actions  of  the  hands  are  described, 
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MOTION  ANALYSIS -STEP  1 


OPERATION !  BRINS  RIFLE  TO  BEAR  ON  TAROET  FROM  THE  PORT  ARMS  POSITION  TO  THE 
SHOULDER  AIM  POSITION,  FIRE  SIX  ROUNDS,  AND  RETURN  RIFLE  TO  THE 
PORT  ARMS  POSITION. 


RiOHT  HAND  LEFT  HANO 


1.  HAND  ASSISTS  IN  CRINGING  THE  RIFLE 
(REAR  STOCK)  TO  RIGHT  SHOULDER 
WHILE  INDEX  FINDER  19  LOOSELY  PO¬ 
SITIONED  ON  THE  TRIOQER.  THE  HAND 
MAINTAINS  A  MODERATELY  FIRM  GRIP 
ON  THE  STOCK, 

2,  THE  REAR  STOCK  IS  POSITIONED 
AGAINST  THE  FRONT  OF  THE  SHOUUDERf 
THE  HAND  INCREASES  ITS  GRIP  ON  THE 
STOCK  EXCEPT  FOR  THE  INDEX  FlNoER 
WHICH  MAINTAINS  AN  ESSENTIALLY  , 
NEUTRAL  POSITION. 

».  WHILE  THE  HAND  (AND  FINDERS,  EX¬ 
CEPT  THE  INDEX  FINDER !  MAINTAINS  A 
FIRM  ARIF  ON  THE  REAR  STOCK,  THE 
INDEX  FINDER  PRESSES  AOAINST  THE 
TRIGGER,  INCREASING  THE  PRESSURE 
UNTIL  IT  TRIM  THE  PIRINS  PIN. 

4,  IMMEDIATELY  AFTER  ASSORT  ION  OF 
TNI  RECOIL,  THE  INDEX  FINDER  IS 
SHIFTED  (MEET  I  NS  NO  RESISTANCE)  TO 
THE  ORIGINAL  POSITION  OF  THE  NEXT 
ROUND. 

ft/  SAME  AS  I. 

«.  SAME  AS  4.  v  ■ 

7.  SAME  AS  3, 

5.  SAME  AS  4. 

9. ' SAME  ASS. 

10.  SAME  AS  4. 

11.  SAME  AS  S, 

IE.  SAME  AS  4. 

13.  SAMI  AS  3. 

14.  SAME  AS  4.Si 

15.  OPPOSITE  OF  I. 


1.  HAND  ASSISTS  IN  BRINGING  RIFLE 
(FRONT  STOCK)  TO  THE  SHOULDER 
LEVEL,  WITH  PALM  AND  FINDERS 
MAINTAINING  A  FIRM  SUPPORT  AND 
GRASP, 

iP 

2.  THE  FRONT  STOCK  IS  POSITIONED 
IN  CONJUNCTION  WITH  THE  REAR 
STOCK  AND  THE  HAND  TAKES  ON  A 
MODERATELY  SEVERE  SUPPORT’ 
FUNCTION, 

S.  HAND  SUPPORTS  THE  FRONT  ST0CK. 


4.  HAND  SUPPORTS  THE  FRONT  STOCK. 


S,  HAND  SUPPORTS  THE  FRONT  STOCK,  . 
S.  HANO  SUPPORTS  THE  FRONT  STOCK. 

7.  HAND  SUPPORTS  THE  FRONT  STOCK. 
S.  HAND  SUPPORTS  THE  PROMT  STOCK, 
S.  HAND  SUPPORTS  THE  FRONT  STOCK, 

10.  HAND  SUPPORTS  THE  FRONT  STOCK. 

11.  HAND  SUPPORTS  THE  FRONT  STOCK, 

12.  HAND  SUPPORTS  THE  FRONT  STOCK. 

13.  HAND  SUPPORTS  THE  FRONT  STOCK. 

14.  HAND  SUPPORTS  THE  FRONT  STOCK. 

15.  OPPOSITE  OF  I, 


L'ituj* 
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You  observe  that  the  wording  in  this  first  slide  is  in  lay  language  and  is 
lengthy,  but  this  was  done  purposely  for  our  presentation.  The  motions 
of  each  hand  are  described  singly,  and  then  listed  synchronously,  one 
beside  the  other.  You  will  see  more  clearly  in  the  next  slide  the  relation^ 
ship  of  the , activities  of  each  hand.  However,  this  first  slide  does  show 
how  motions  are  described  in  terms  of  elements  and  a  method  for  analysing 
them. 

Ij  "  •’  •  ...  " 

ii 

|  In  Slide  2  (Figure  2)  you  see  a  condensation  in  the  language  as  com¬ 
pared  to  Slide  1.  This  terminology  is  often  employed  by  motion  analysts. 
Note  how  quickly  you  can  get  a  visual  time-history  of  the  events  on  the 
part  of  each  hand.  In  order  to  emphasize  the  more  important  factors  in 
such  an  operation,  one  usually  includes  a  clear  descriptive  summary 
showing  numerical  relationships  between  active  and  inactive  motions, 

This  same  cps ration  cycle  has  been  made  a  little  mere  sophisticated 
in  Slide  3  (Figure  3)  by  adding  a  graphical  representation  for  the  various 
kinds  of  elements,  One  purpose  of  this  format  is  to  emphasise  the  idle 
or  Inactive  elements,  I  should  point  out  that  ordinarily  these  graphical 
representations  are  in  terms  of  time  per  element  giving  a  quantitative 
as  well  as  a  qualitative  measure,  Our  example  here  ie  hypothetical  and 
admittedly  would  be  more  effective  if  a  full  motion-time  study  were  made, 
However,  the  purpose  is  to  point  out  a  methodology  useful  in  studies  re¬ 
lating  body  mechanics  to  machine  and/or  task  characteristics. 

By  applying  this  technique  to  human  taska  and  translating  such  ob¬ 
servations  into  anatomical  mechanics,  one  may  be  able  to  specify  in 
more  detailed  fashion  the  various  biomechanical  pathway e  employed  by 
humans  for  given  functional  disabilities.  We  all  know  of  unusual  accom¬ 
plishments  on  the  part  of  some  handicapped  workers,  The  same  is  true 
for  some  accident  victims  immediately  following  trauma.  Certainly  the 
time  parameter  and  undoubtedly  a  host  of  others  are  Important,  such  as 
environmental  conditions,  task  nature,  human  motivation,  etc, ,  and 
should  be  specified  in  mo  deling  man -task  behavior  under  conditions  of 
disability,  In  this  way,  redundant  bio  mechanical  networks  available  to 
the  human  may  be  weighted  and  probabilltistic  methods  applied,  It  is,  of 
course  assumed  to  be  necessary  to  have  a  definition  for  normal  perfor- 

mance  £ur  any  given  task  as  a  baseline. 


operation:  bring  rifle  to  bear  on  target  from  the  port  arms  position 

TO  THE  3HOULDRR  AIM  POSITION,  FIRS  SIX  ROUNDS,  AND  RETURN 
RIFLE  TO  THE  PORT  ARMS  POSITION. 


JU9HL-H.AND 

^  “  •  ; 

LEFT  HAND, 

1.  TRANSPORT  LOADED'  ! 

1.  TRANSPORT  LOADED 

S.  POSITION  | 

S.  POSITION 

9.  PULL  LOADED  UNDER  FINGER)  S  HOLD 

3.  SUPPORT  A  HOLD 

4.  PUSH  EMPTY  (INDEX  FlNOER )  A  HOLD 

4.  SUPPORT  A  HOLD 

9,  PULL  LOADED  (INDEX  FINGER)  A  HOLD 

S.  SUPPORT  A  HOLD 

S.  PUSH  EMPTY  (INDEX  FINGER )  A  HOLD 

«,  SUPPORT  A  HOLD 

7.  PULL  LOADED  (INDEX  FINGER)  A  HOLD 

7.  SUPPORT  A  HOLO 

«.  PUSH  EMPTY  (INDEX  FINGER)  A  HOLD 

A.  SUPPORT  A  HOLD 

A.  PULL  LOADED  (INDEX  FlNOER)  A  HOLD 

A.  SUPPORT  A  HOLD 

10.  PUSH  EMPTY  (INDEX  FINGER)  A  HOLD 

10.  SUPPORT  A  NOLO 

II.  PULL  LOADED  (INDEX  FlNGEN)  A  HOLD 

II.  SUPPORT  A  HOLD 

IS,  PUSH  EMPTY  (INDEX  FlNGEN )  A  HOLD 

II.  SUPPORT  A  HOLD 

IS.  FULL  LOADED  (INOEX  FINGER)  A  HOLD 

13.  SUPPORT  A  HOLO 

14.  PUSH  EMPTY  (INDEX  FINGER)  A  HOLD  , 

14.  SUPPORT  A  HOLD 

19.  TRANSPORT  LOADED 

10.  TRANSPORT  LOADED 

SUMMARY 


TOTAL  NO  OF 

NO  OF  ACTION 

ELEMENTS 

ELEMENTS 

IS 

IS  (100%) 

0(0%) 

■qTnrrrr» 

IS 

MSO%) 

IE  (00%) 

FIGURE  2 
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MAH^TASK  CHART 


OPERATION:  bains  rifle  to  bear  on  taaoet  from  the  port  arms  position 
TO  THE  SHOULOt R  AIM  POSITION,  FIRE  SIX  ROUNDS,  ANO  RETURN 
RIFLE  TO  THE  PORT  ARMS  POSITION. 


RISHT  HANS. 
TRANSPORT  LOADED 
POSITION 

PULL  LOADED  •  HOLD 
PUlH  EMPTY  S  HOLD 
PULL  LOADED  •  HOLD 
PUSH  EMPTY  A  HOLD 
PULL  LORDED  A  HOLD 
PUSH  EMPTY  A  HOLO 
PULL  LOAOIO  A  HOLO 
PUSH  EMPTY  A  HOLD 
PULL  LOADED  A  HOLD 
PWIN  EMPTY  •  HOLD 
PULL  LOADED  AHOLD 
PUSH  EMPTY  A  HOLD 
TRANSPORT  LOADED 


LEFT  HAND 
TRANSPORT 
POSITION 
SUPPORT  A 
SUPPORT  A 
SUPPORT  A 
SUPPORT  A 
SUPPORT  A 
SUPPORT  A 
SUPPORT  A 
SUPPORT  A 
SUPPORT  'll 
SUPPORT  A 
SUPPORT  A 
SUPPORT  A 
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You  can  see  the  additional  work  required  to  correlate  motion  me¬ 
chanics  with  anatomical  causes  since  we  must  concurrently  consider 
supporting  postural  states,  The  need  for  unique  mathematics  is  apparent 
for  we  are  dealing  with  complex  functions.  For  example,  we  are  inter¬ 
ested  in  the  role  or  contribution  of  an  individual  muscle  or  muscle-group 
in  its  relationship  to  an  array  of  essential  tasks.  This  has  not  been 
done  in  the  past  either  by  engineers  or  psychologists  to  the  best  of  our 
knowledge  for  tasks  at  large. 

As  stated,  it  is  of  primary  interest  to  try  and  study  the  relationships 
that  might  exist  between  anatomical  structures  and  their  resulting  human 
motion  complexes,  It  becomes  obvious  that  in  spite  of  one  or  even  more 
than  one  imposed  functional  disability,  one  may  perform  a  defined  task 
satisfactorily,  Case  studies  have  been  reported  where  in  times  of  actual 
injury,  human*  perform  miraculously.  Extreme  motivation,  fear,  pain, 
and  a  host  of  other  psychological  and  physiological  factors  are  deeply  im¬ 
bedded.  However,  if  the  structure-function  pathways  did  not  exist,  high 
motivation  alone  could  not  create  new  physical  anatomical  entities, 

Another  important  apectrym  of  feasible  alternatives  derives  from  the 
environment  not  considered  in  this  paper. 

In  an  anatomical  review  of  the  upper  limb  musculo -skeletal  system, 
it  Is  observed  that  for  given  muscle  dysfunctions,  others  are  often 
available  to  assist  in  the  accomplishment  of  a  specified  task.  Your  atten¬ 
tion  is  directed  to  Table  X  in  which  you  observe  an  anatomical  matrix 
of  upper  limb  muscles,  The  columns  are  anatomical  actions,  The  rows 
are  the  muscles  arranged  in  order  from  top  tp  bottom  to  correspond  to 
the  proper  regions  from  shoulder  to  fingers.  Notice  that  in  almost  all 
cases,  more  than  one  muscle  contributes  to  a  given  anatomical  motion, 
This  is  shown  by  the  presence  of  more  than  one  x  in  any  column.. 

It  is  believed  that  we  are  getting  closer  to  technical  explanations  as 
to  why  some  perform  •'miraculously"  under  handicap,  It  is  the  moti¬ 
vation  that  is  mirculous,  we  can  do  pretty  well  from  the  technical  or 
biotechnical  point  of  view. 

Wo  are  giving  serious  thought  to  the  development  of  a  functional 
anatomical-physiological  model  of  man  considering  all  body  systems,  ' 
or  subsystems,  such  as  the  musculo- skeletal,  cardiovascular,  nervous, 
respiratory,  gastrointestinal,  and  genito-urinary,  using  what  physiologi¬ 
cal  feedbacks  we  know  about  and  can  use.  Ordinarily  we  would  avoid  Buch 
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complexity,  but  you  must  remember  that  bur  analysis  actually  begins  with 
wound  tract  pathology  or  tissue  trauma  assignable  to  given  fragment  physics. 
A  task  need  not  suffer  if  its  imposed  demands  are  not  beyond  certain  limits. 
Table  I  shows  the  structure -function  relationships  for  the  human  upper 
limb.  Functionally,  redundancies  are  present.  This  is  indicated  as 
mentioned  in  Table  I  by  examining  anatomical  functions  performed  by  more 
than  one  muscle.  In  order  to  be  more  correct  the  x's  should  be  of  vari¬ 
able  size  to  indicate  in  a  more  quantitative  sense,  weighted  contributions 
on  the  part  of  the  respective  muscles.  The  point  is  that  redundancies  in 
terms  of  anatomical  capability  to  perform  exists  to  accomplish  external 
actions.  They  exist  in  a  given  anatomical  region.  They  exist  also  because 
of  anatomical  duality  since  many  tasks  are  not  fully  demanding  in  terms  of 
both  limbs  simultaneously.  Postural  changes  may  compensate  satisfactorily 
for  such  losses. 

RELIABILITY  OF  SYSTEMS.  The  reliability  of  a  system's  performance 
may  be  related  to  the  objective  which  the  system  is  expected  to  attain.' 

Since  we  are  concerned  with  the  complex  living- system  coupled  to  inanimate 
components,  nature's  Solutions  to  reliability  phenomena  are  of  special  in# 
terest.  This  is  e specially  true  If  the  objective  function  of  a  given  ballistic 
fragment  is  to  maximize  the  disruption  of  this  living-performing  arrange¬ 
ment.  At  the  biological -call  level  the  answer  to  unreliability  is  the  pre¬ 
sence  of  many  more  cells  than  are  required,  most  of  which  are  In  parallel 
linkages.  According  to  W,  S,  McCulloch*  Von  Foerster  expresses  the  view 
that  whatever  else  It  (an  ordered 'living'  system)  contributes,  a  redun¬ 
dancy  of  structure  is  fundamental.*,**  McCulloch  also  states  ,  ,  , 

"that  which  is  redundant  is,  to  the  extent  that  it  is  redundant,  stable.  "** 

Such  phenomena,  including  information,  channels,  and  structure  are 
Important  if  additional  Insight  is  to  be  attained  concerning  explanations  for 
the  adaptation  and  compensation  powers  so  often  demonstrated  by  human 
■body  behavior.  .■» 


"On  Self-Organizing  Systems  and  Their  Environments,  "  by  H.  Von 
Foerster.  Fron  "Self-Organizing  Systems  Proceedings  of  an  Inter- 
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"The  Reliability  of  Biological  Systems,  "  by  W.  5,  McCulloch,  same 
publication. 
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Reliability  can  be  defined  statistically  as  the  probability  "P"  that  an 
element  or  a  system  will  perform  satisfactorily  for  a  given  period  of 
time.  Unreliability  is  the  probability  of  a  failure  during  a  specified  time 
and  is  given  as  "q"  =  1-P.  Here  independence  assumes  that  the  failure 
of  one  element  does  not  affect  the  probability  of  failure  of  any  other  ele¬ 
ment.  Trauma  from  various  causes  has  not  yet  be'eii  iltiidied  in  this  sense, 
but  it  is  being  proposed.  However,  the  lack  of  knowledge  of  complex  bio¬ 
logical  system  behavior  would  seem  to  favor  the  application  of  stochastic 
processes  at  the  present  time. 

If  redundancies  exist  in  human  biomechanics  as  well  as  for  the  many 
supporting  subsystems,  the  act  of  purposely  inhibiting  any  single  channel, 
even  if  it  were  feasible  to  identify  it,  may  not  yield  applied  information 
most  needed  at  the  present  time.  Other  channels,  especially  those  we  are  " 
not  yet  aware  of,  may  take  over.  However,  "groups11  of  redundant  channel 
Inhibition  may  yield  significant  responses. 

If  we  study  task  requirements  In  terms  of  biomechanical  redundancies, 
We  can  begin  to  describe  these  pathways.  It  is  well  known  that  no  task 
requires  all  available  channels.  Hypothetically,  then,  performance  decre¬ 
ment  due  to  a  specific  chahnel  deficit  may  not  be  significant.  Our  intro¬ 
ductory  observations  regarding  given  functional  losses  for  defined  tasks 
show  some  influence  on  performance  behavior  .  We  are  probably  dealing 
in  some  measure  with  numerical  discontinuities  and/or  non-linear  systems, 

'■  But  what  are  the  boundary  conditions  ?  How  will  those  vary  from  task 
to  task?  How  much  subsystem  understanding  is  required  or  when  can  it 
simply  be  "blackboxed"  ?  We  feel,  as  others  do,  that  In  complex  systems 
in  which  there  is  a  problem  to  be  solved,  it  makes  sense  to  speak  of  the 
quality  of  a  solution.  The  method  of  solution  is  determined  to  a  large  ex¬ 
tent' by  the  problem  objective.  Herein  may  lie  the  reason  for  some  of  the 
differences  obtained  when  many  views  are  taken  of  the  same  problem.  The 
approach  may  be  identical  but  inputs  may  bo  biased  in  various  ways.  In¬ 
puts  and  criteria  obviously  influence  output  numbers.  j 

It  is  interesting  to  note  that  research  programs  in  the  life  sciences 
are  increasingly  accentuating  the  need  for  increased  knowledge  concerning 
fundamental  processes,  principles^  and  mechanisms  found  in  biological 
systems.  For  the  present,  we  must  formulate  and  use  what  basic  homeo¬ 
static  mechanisms  known  by  which  body  processes  are  regulated.  Studies 
are  being  made  of  adaptive  and  regulatory  processes;  neural  network 
theory;  reflexeB  and  other  feedback  systems;  random  redundant  processes; 
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sensing  and  transducer  mechanisms;  the  specificity  of  sensory  and  motor 
phenomena  and  other  such  functions.  It  has  only  been  in  recent  years 
that  interest  in  the  study  of  physical  and  mathematical  principles  relating 
to  control  systems  has  become  intensified. 

Two  general  approaches  to  incapacitation  assessment  are  of  immedi¬ 
ate  interest  to. us,  namely,  (1)  the  medical  and  biophysical  aspects  of 
pathological  dynamics  for  certain  fragment  physics,  and,  (Z)  the  prob¬ 
able  performance  alterations  for  specified  tasks  due  to  the  traumatic  effects 
of  such  traumata. 


SUMMARY ,  In  summing,  it  is  believed  that  the  following  ideas  are  imr 
portant: 

1.  Humans  possess  a  general-purpose  type  of  anatomical  structure- 

function  arrangement.  Overlap  And  redundance,  indicated  by  th«  fact 
that  more  than  one  muscle  contributes  to  the  same  anatomical  function 
and  the  presence  of  duality  particularly  in  the  upper  and  lower  limbs,  are 
factors  contributing  to  the  nature  of  this  capability,  This  same  idea  may 
be  carried  down  to  the  cellular  level  for  a  single  musqle  inasmuch  as 
muscle  cells  exist  in  a  large  number  of  subsets  many  of  which  are  in 
parallel.  Finally,  we  might  add  that  even  a  single  living  cell  may  have 
different  capacities  depending  on  many  physiological  factors  including 
conditioning.  -  -  .  , 

2,  In  this  context  it  is  felt  that  the  load  or  demand  on  the  general- 
purpose  human  is  a  significant  function  of  task  requirements,  Quality  of 
performance,  imposed  physical  forces,  variable  time  durations,  en¬ 
vironmental  factors,  and  motion  behavior  in  3 -dimensional  space  are  items 
that  may  vary  radically  from  one  task  to  another. 

3,  In  assessing  disability  performance  a  definition  of  non-disability  per¬ 
formance  is  essential.  We  recognize  the  need  for  unique  combinations 
of  talents  in  this  interdisciplinary  problem  area. 

4.  A  large  amount  of  experimental  information  concerning  man-task 

dynamics  can  be  generated  for  specified  tasks  using  conventional  work 
mcadui o.uuit  techniques  in  conjunction  with  physiological  instrumentation 
and  control  system  knowledge  now  available.  "  ij 
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Appendix 

UPPER  LIMB  MUSCLE  CODS 


Code  Muscle  Name 

Shoulder; 

Trapezius 

Aq  Serratus  anterior 

A*  Suhalaylue 

A 4  Pectoralls  minor 

Aj  Pectoralls  major 

Ag  Subscapularis 

Art  Bupraspinatua 

Aq  Infraspinatus 

Ajj  Terse  minor 

A10  Teres  major 

Ajj  Bleeps  bra oh 11 

A^2  Coracobrachlalls 

A^j  Triceps  brnqhll 

A^  Deltoid. 

Armi 

Ajj  Bleepe  braohli 

Aj*  Triceps  braohli 

A^g  Ooracobraohlalls 

Bx  Braohloradialls 

®2  Braehlalls 

Bj  Anconeus 

Porekrm! 

Ajj,  Bleepe  braohli 

Ai*  Trleepe  braohli 

S'£J  Braohloradialls 

®3  Anconeus  '  'V 

Ol  Supinator 

Ofi  Pronator  quadratus 

031  Pronator  teres 

O4  Plexor  carpi  radlalis 

O5  Extensor  carpi  radlalis  longue 

0g  Plexor  dlgltorum  aublials 

O7  Plexor  carpi  ulnar is 

00  Extensor  carpi  radlalis  brevis 

0$  .  Extensor . carpi  ulaarle  . 

W1Q  Plexor  digitorua  profundus 
O11  Extensor  dlgltorum  ooenunls 
0j2  Pa  bawls  longue 

Cjs  Abductor  poUlois  longue 

0l4  Plexor  polllcis  longue 

C15  Extensor  Indicia  proprius 

0l6  Extensor  digit!  quint 1  proprius 
O17  Extensor  polllcis  loagus 


Code  Muscle  Kane 

Band: 

Cg  Plexor  dlgltorum  aublials 

Cjq  Flexor  dlgltorum  profundus 
Extensor  dlgltorum  communis 
D£  Extensor  polllole  brevis 
O37  Extensor  poiliois  longue 
Dg  Abduotor  poiliois  bravla 
C13  Abduotor  polllcis  league 
CL  Plexor  polllcis  longue 

D,  Plexor  polllcis  brevis 

QU  Extensor  Indicia  proprius 
Oig  Extensor  dlglti  qulntl  proprius 
D4  Plexor  dlglti  qulntl  brevis 
D5  Abductor  dlglti  qulntl 

»S  Abduotor  polllcis 

Dj  Pabsarls  brevis 

Dq  Oppooens  polllcis 

Dq  Oppooens  dlglti  qulntl 

Pjo  lumbrioalss 

D11  Xnterossal  dorsales 

Dja  Xnterossel  volarss 


i!" 
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UPPER  LIMB  MOTOR  FUNCTIONS  AND  CAUSAL  FACTORS 

_  fOREARH  _ _ _ _ HAND  AMD  QUITS _ _ 
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X  X  X 


X 

X  XX 
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X  X 


X  8 
X  X 
X  X 


X  X 


X  X 


(See  Appepdi*  for  identification  of  code) 


&  Steal!' 


HALF -NORMAL  PLOTS  , 

FOR  MULTI-LEVEL  FACTORIAL  EXPERIMENTS  1 

i 

S.  A,  Kr&ne  I 

C-E-I-R,  Inc,  ,  Dugway  Field  Office  1 

1.  INTRODUCTION,  Half-normal  plots  for  the  interpretation  of  lP 
factorial  experiments  have  been  developed  and  popularized  largely  through 
the  work  of  Cuthbert  Daniel  (  see  Daniel  [l956]  and[l959]),  In  this 
method  the  2^  -  1  main  effects  and  interactions  are  estimated  from  ob¬ 
servations  on  the  2P  treatment  combinations.  The  empirical  cumulative 
distribution  of  these  estimates  is  then  graphically  compared  with  a  cu¬ 
mulative  distribution  derived  from  a  normal  population.  A  rationale  for 
l  this  procedure  is  found  in  the  approximate  normality  of  the  null  distri- 

|  button  of  the  estimates,  based  upon  normality  of  experimental  errors  or 

I  upon  the  tendency  embodied  in  the  Central  Limit  Theorem,  According 

%  to  Daniel,  the  half-normal  plot  permits  the  analyst  to  judge  the  reality 

I  of  the  largest  main  effects  and  interactions  and  serves  to  indicate  bad 

I  values,  heteroscedasticity,  dependence  of  variance  on  mean  and  some 

types  of  defective  randomization,  The  object  of  the  present  paper  is  to 
indicate  and  illustrate  possible  applications  of  half -normal  plots  to 
balance  multi-level  factorial  experiments  in  general. 

I  2.  AN  EXAMPLE,  It  appears  easiest  to  introduce  the  technique  of 

l  half-normal  plotting  for  balanced  multi-level  factorial  experiments  in  the 

context  of  a  particular  example.  For  this  purpose  we  shall  employ 
Example  S.  1  of  Davie#  [l954J.  According  to  the  author#  (p,  291,  "the 
■data  .  .  .  are  taken  from  the  results  of  an  investigation  into  the  effect# 
on  the  physical  properties  6f  vulcanized  rubber  of  varying  a  number  of 
factors,  the  property  recorded  being  the  wear  resistance  of  the  samples, 

\  and  the  factors  being!  ? 

A  five  qualities  of  filler 

B  three  methods  of  pretreatment  of  the  rubber 

C  f  our  qualities  of  the  raw  rubber  ..." 

The  data  are  reproduced  in  Table  1.  From  the  data,  the  author  develops 
the  usual  analysis  of  variance  as  shown  in  Table  2.  The  interpretation 
(Davies  Q.9 54,  p.  29^  )  notes  the  significance  of  all  main  effects  and  two  - 
•  factor  interactions  when  tested  against  the  three -factor  interaction  as 
i  error, 
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In  order  to  analyze  the  given  experimental  data  by  half-normal 
plotting,  v.’s  shall 'reduce  the  data  to  single  degree  of  freedom  sums  of 
squares,  The  method  to  be  used  depends  upon  the  definition  of  complete 
setsjjof  orthogonal  contrasts  for  each  of  the  factors  A,  B,  and  C,  This 
definition  generally  is  somewhat  artibrary,  but  it  is  our  experience 
that  an  experimenter  familiar  with  the  nature  of  the  factor  levels  and 
the  purpose  of  the  experiment  can,  in  most  instances,  provide  suffi¬ 
cient  justification  for  the  prior  definition  of  a  meaningful  complete  set 
of  single  degree  of  freedom  orthogonal  contrasts  among  the  levels. 

The  use  of  orthogonal  polynomials  for  quantitative  levels  it  often  indi¬ 
cated,  while  for  qualitative  levels,  meaningful  comparisons  among 
certain  levels  are  often  obvious,  On  occasion,  Only  a  partial  set  of 
orthogonal  comparisons  will  appear  to  be  of  intrinsic  value  and  it  may 
be  necessary  to  complete  the  orthogonal  set  by  adding  contrasts  of  no 
apparent  importance.  In  the  absence  of  useful  information  on  the  nature 
of  the  levels  (except  that  they  are  all  qualitative)  in  the  present  example, 
we  shall  be  totally  arbitrary  in  defining  the  contrasts*  but  will  attempt 
to  indicate  their  potential  Interpretations.  -These  contrasts  are  shown 
in  Table  3.  For  factor  A,  contrast  Afl,  is  the  "null"  or  "average" 

contrast*,  while  A^  compares  the  average  of  levels  1  and  2  against 
the  average  of  levels  3,  4  and  5,  A 2  compares  level  1  vs.  level  2,  Aj 
compares  level  3  against  the  average  of  levels  4  and  5  and  A^ 

compares  level  4  with  level  5.  The  orthogonality  of  the  set  is  evident 
in  that  the  coefficients  sum  to  zero  for  all  contrasts  except  the  null 
contrast  and  the  surh  of  products  of  coefficients  is  zero  for  all  pairs 
of  contrasts.  For  factor  B,  the  non -hull  contrasts  compare  level  1 
with  level  2  with  the  average  of  levels  1  and  3,  (In  another  context. 

Bj  and  are  the  orthogonal  polynomials  for  three  equally  spaced 

levels,  B,  being  the  linear  contrast  and  Bg  the  quadratic. )  For  factor  C, 
the  contrasts  Cj,  Cg  and  C-j  make  the  following  comparisons  among  levels* 
respectively:  (1  and  2)  vs.  (3  and  4),  (1  and  3)  vs.  (2  and  4)  and  (1  and  4) 


>* 

Daniel  1962  has  suggested  the  term  "mill"  is  inappropriate  because 
of  the  generally  positive  expectation  of  this  contrast.  We  chose  the 
term  because  (i)  it  is  connoted  by  our  zero  subscript  notation,  < ii) 
this  contrast  is  not  a  comparison  among  levels,  and  (iii)  this  contrast 
is  generally  "of  no  consequence"  in  the  analysis, 
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vs.  (2  and  3).  These  contrasts  would  be  of  interest,  e.  g.  ,  in  the  event 
that  factor  C  incorporated  two  subfactors,  say  D  and  E,  where 
levels  land  2  are  at  the  low  level  of  D  and  levels  3  and  4  at  the 
high  level  of  D,  while  levels  .  1  and  3  are  at  the  low  level  of  E  and  2 
and  4  at  the  high  level  of  E.  Then  Cj  is  the  effect  of  D,  is  the 

effect  Of  E  and  C3  is  the  interaction  of  D  and  E. 

The  three  sets  of  contrasts  (A  j ,  A^,  Ay  A^),  ■  { B j >  Bg)  and 
(Cj ,  C^i  Cj)  will  provide js  basis  for  reducing  the  sum e  of  squares  for 
factor  A  (4  d.  f. ),  factor  B  (2  d,  f. )  and  factor  C  (3  d,  f,  j  to  indepen¬ 
dent  single  degree  of  freedom  sums  of  squares*  It  remains  to  develop 
•uch  a  basis  for  the  two-  and  three^factor  interactions.  A  natural 
method  for  accomplishing  this  is  the  extension  of  the  original  single 
factor  contrast  acta  to  interaction  contrast  feats.  This  method  is  exem¬ 
plified  in  Table  4  for  Factors  B  and  C.  All  possible  combinations 
61  the  levels  of  B  and  C  are  employed  as  columns,  while  rows  are 
contrasts.  For  any  combination  of  a  particular  levsli  say  1,  of  B 
with  a  particular  level,  say  j,  of  C,  the  coeffloient  in  the  contrast 
BqCj.  is  obtained  by  multiplication  of  the  coefficient  of  level  1  of  B 
in  the  contrast  Bq  by  the  coefficient  of  level  j  or  C  In  the  contrast 

Cr.  Sums  of  squares  of  the  B  and  C  contrasts  may  be  obtained  by 
multiplication  of  the  corresponding  sums  of  squares  for  B  and  for  C. 

Of  the  12  orthogonal  contrasts  in  Table  4,  BqCq  Is  the  null  contrast 
while  the  contrasts  BqCj,  BqC2,  BqCj,  B^q  and  Bj,C0  are  simply  the 
original  contrasts  C,  ,  C2,  C3,  Bj  and  Bjj,  respsotlvely,  averaged  over 
all  levels  of  the  other  factor.  The  six  contrasts  BjCj,  BjGg,  BjC^, 

BjjOj  >  B2C;3  are  new  and  constitute  a  basis  for  partitioning  the  BC 

interaction  sum  of  squares  (6  d.  f. )  into  orthogonal  single  degree  Of 
freedom  sums  of  squares.  Application  of  this  method  will  likewise  pro¬ 
duce  bases  for  partitioning  the  sums  of  squares  for  AB  <8  d.  f, ),  AC 
(12  d.  f. )  and  ABC  (24  d.  f. ). 

The  above  method  of  defining  interaction  contrasts  is  incorporated 
in  the  method  we  employ  for  calculating  halft-normal  variates  by  desk 
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calculator.  A  sample  work  sheet  for  this  method  is  shown  in  Table  5a 
and  5b*.  Section  I  of  this  table  is  merely  a  recopying  of  the  original 
data  from  Table  1.  In  this  section  a  column  of  five  numbers  represents 
the  observations  for  the  five  levels  of  A  over  a  particular  one  of  the 
twelve  combinations  of  levels  of  B  and  C  represented  by  columns.  Section 
U  is  computed  by  operating  on  these  columns  with  the  contrast*  Aq,  Ajr 

A  Aji  A^.  ?o?  example,  products  of  the  coefficients  of  Aq  with  the 
corresponding  element*  of  a  particular  column  are  formed  and  these 
five  products  are  summed  and  entered  in  Section  II  in  the:  first  row  of 
that  column.  Similarly,  sums  of  products  of  coefficient*  of  Aj  with 

corresponding  elements  of  columns  are  entered  in  the  second  row  of 
Section  II,  and  so.  forth.  Thus  sach  elsment  of  Section  II  is  formed  as 
a  sum  of  products  of  coefficients  of,  say,  Ap  with  corresponding  ob- 

servations  and  is  entered  on  ths  (  pti  )-th  row  of  the  appropriate  column. 

Section  11  may  be  visualised  as  an  aggregation  of  20  rows  of  three 
elements  each,  where  each  row  corresponds  to  a  particular  contrast  of 
A  and  a  particular  level  of  C,  Ths  three  elements  of  each  row  oorres* 
pond  to  the  three  levels  Of  3.  Now  Section  111  is  formed  from  Section  11 
by  summing  products  of  coefficients  of  the  B  contrasts  and  aorreapondlng 
elements  of  each  row  of  three.  Each  such  sum  of  products  is  entered  in 
the  corresponding  row,  with  the  sum  of  products  from  coefficient*  of  B~ 
entered  as  the  (  q  +  1  )-th  element  of  that  row. 

Section  III  may  be  visualised  as  comprising  four  sub-seogtion*  of  1ft 
elements  each,  with  the  elements  of  a  sub- section  corresponding  to  a 
particular  contrast  of  AB  {i.  e. ,  a  particular  combination  of  a  contrast 
of  A  and  a  contrast  of  B)  and  the  four  sub- sections  corresponding  to  th* 
four  levels  of  C,  Section  IV  is  formed  from  Section  III  by  summing  pro¬ 
ducts  of  coefficients  of  the  C  contrasts  an4 identically  placed  elements 
from  the  four  corresponding  sub-section*.  The  sum  of  product*  is 
entered  in  the  corresponding  place  of  one  of  the  sub- sections  of  Section  IV, 
with  the  sum  of  products  from  coefficients  of  entered  in  the  (rH^th 
sub- section. 


* 

This  calculation  method  is  essentially  the  same  as  that  given  in 
Appendix  8G  of  Davies  [1954,  pp.  363 -6 J .  In  some  instance*  the 
format  in  Davies  (with  the  addition  of  final  column  of  half-normal 
variates)  may  be  preferred. 
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The  method  of  calculation  of  Sections  II,  III  and  IV  may  not  be  appar¬ 
ent  at  first  glance,  but  verifying  part  or  all  of  the  data  in  Table  5a  from 
the  description  above  should  help  to  clarify  the  process.  Computing  clerks 
■will  find  it  helpful  to  write  the  coefficients  of  each  contrast  on  a  strip  of 
paper,  appropriately  oriented  vertically  or  horizontally  and  spaced  so 
that  when  overlaid  on  the  worksheet  each  coefficient  appears  adjacent 
to  the  element  to  be  multiplied.  ■' 

Section  V  (Table  5b)  merely  identifies  the  elements  of  Section  IV  and 
subsequent  sections  according  to  the  contrasts  they  represent.  This 
Identification  is,  of  oourse,  highly  systematic  and  might  well  be  omitted 
when  familiarity  with  the  method  is  attained. 

Section  VI  contains  the  "divisors",  obtained  by  multiplying  the  sums 
of  squares  of  the  coefficients  of  the  contrasts  Ap,  Bq,  Cr  appropriate  to 

each  element,  as  found  in  Table  3, 

Section  VJI  contains  the  single  degree  of  freedom  lumi  of  squares 
corresponding  to  each  contrast,  Each  element  is  obtained  by  squaring 
an  element  of  Section  IV,  dividing  by  the  corresponding  element  of 
Section  VI  end  entering  in  the  corresponding  place  of  Section  VII, 

Section  VIII  contains  the  half-normal  variate  values,  each  of  which  y 
is  computed  as  the  square  root  of  the  corresponding  element  of  Section  VII, 
positive  or  negative  according  to  the  sign  of  the  corresponding  element  of 
Section  IV,  (It  would  perhaps  have  bsen  advisable  to  include  the  first 
decimal  of  each  of  these  values  in  order  to  discriminate  more  fully  among 
them, )  ■ 

■  -  ■  V,.'.  '  .  ' 

Certain  check  computations  in  the  method  have  been  omitted,  but  an 
over-all  check  can  be  readily  obtained  from  Section  VII  by  comparing 
sums  of  these  single  degree  of  freedom  sums  of  squares  with  the  usual 
analysis  of  variance  of  Table  2.  These  checks  are  indicated  in  Table  6. 

It  will  be  noted  that  all  sums  of  squares  agree  with  Table  2  within  the 
expected  rounding  error  accumulated  from  Section  VII. 

The  half-normal  variates  must  now  be  ordered  by  magnitude  before 
plotting.  This  ordering  is  shown  in  Table  7,  along  with  an  identification 
of  the  contrast  represented  (letters  with  subscripted  zeroes  have  been 
dropped)  and  the  appropriate  quantile  of  the  empirical  distribution,  de¬ 
fined  by  "  ..  ,v 
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Table  7 .  HALF-NORMAL  VARIATES 
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where  k  is  the  rank  order  and  n  In  the  number  of  variate*.  Here,  a* 
in  moat  inetancea,  it  seems  appropriate  that  the  null  contraet  be  excluded 
from  the  variate*  to  be  examined,  The  lign  Of  the  contrast  is  now 
attached  to  the  label  and  only  positive  variates  are  plotted. 

The  variate  values  and  quantiles  are  next  plotted  bn  halfi-normal 
probability  paper  (as  in  Figure  1)  for  interpretation.  Discueelon  of  the 
interpretation  phase  of  the  analysis  of  this  example  will  be  deferred  to 
a  later  eection.  r'  "\; 

3,  SOME  THEORY*.  At  this  point  we  ihall  touch  briefly  on  eome 
theoretical  aepecte  of  the  development  of  half-normal  variate •  from  multi¬ 
level  factorial  experiment!.  To  eimplify  the  diacuesion  we  shall  assume 
that  we  are  concerned  with  a  threeffactor  experiment,  although  it  ehould 
be  remembered  that  the  theory  and  methodology  apply  with  equal  validity 
to  any  number  of  factore, 

We  denote  by  y^,  the  observation  obtained  with  factor  A  at  level  h, 
factor  B  at  level  1  and  factor  C  at  level  J,  where  h  ■  1,2,,..  ,  at 
1  «  1,  2,  . . , ,  b|  j  «  1,  2,  , . , ,  o.  The  coafflciantt  of  the  orthogonal 
contrasts  for  factor  A  will  bs  indicated  by  a^,  denoting  ths  coefficient 

for  levs  1  h  in  the  p«th  contrast,  Similarly  the eoeffleietttf  of  ttirf-aoh- 
trasts  for  factors  B  and  C  are  denoted  and  crj,  respectively. 

We  assume  that  for  each  factor  there  is  a  null  contrast,  these  being  din* 
noted  Aq,  B0,  Gq  and  defined  by 

aoh  a  boi  “  coJ  “  1}  h*  i‘  J* 


This  section  is  based  on  well-known  results  concerning  distributions  of 
liner  r  functions  of  random  variables  and  may  be  verified  by  reference 
to  standard  introductory  texts  on  mathematical  and  theoretical  statistics. 
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Furthermore,  by  the  definition  of  orthogonal  contrasts, 


E  »„„■ 


C.I  1  o 


p  -  1,2, . ,, ,  a-1;  q  ■  1,2,... ,  b«li  r  ■  1,2,.. . ,  r  -  lj 


i  ;  ....  r  ' 

E  *Ph  Vh "  ?  bci  b«’i'  TV 


■ .  c  i »  ■  0 ' 

rj  r'j  v 


P  />  P'i  q  *  q'j  r  +  r1. 
The  thrs* -factor  contrasts  are  defined  by 


^  ^  ^  *ph  bqi  CJfJ  yWjS 


p  =  0, 1, . . . ,  a-l>  q  ■  0, 1, . . , ,  b-1;  r  ■  0, 1 , . . c-i.  ' 


Suppose  that  there  are  no  treatment  effects  ,  i.  e. , 


E  (y  }  «  fW  all  h,  i,  J} 

hij 

and  that  the  experimental  error*  at1*  independent  and  hay*  constant 
variance  for  all  observations,  i.  e. , 

!  E  {(yhU  -  /U2}  *  cr2i  all  h,  i,  j. 


*  r1 
The  symbol  i  u  /denotes  the 


Then 


unless 
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E  tv,cJ  ■  °< 


P  a  0,  q  a  0  and  r  »  0,  in  which  case 


EW  Bofo^*bc  t‘ 


S\irthermore  , 


2  t  2.  ? 


v{AACr]  . 


Denote  by  ^pqf  *1»®  variate  defined  by 


Then 


V  ■  <APV'’ 


«t  v>  'iv'? •* >• 

n  V  j 


*  V  *.»© 


E  (Ypqr}  ■  0,  unless  p  -0,  q  •  0,  f  «  0> 

vKd  *  <? ■ 


T  t  aU  m.  HM^nl  M  ■HWBt*  e  see  M  rt  4k  11»r  H4  tb*n  tfi m  ' Y  urn 

AA  MSB  s  s**#,*#f  we  *w*  -  *»•  *■»  »•'•'  -  -»••-—/  T~*  p(|j*--/--~-;  - 

normally  distributed.  (Under  fairly  weak  assumptions  the  ^pqx  will  tend 

to  be  normally  distributed  in  large  experiments  even  for  non-normal 
distributions  of  experimental  error.)  Then  the  non-negative  half-normal 
variates, 

The  symbol  V  {  }  denotes  the  variance  operator,  V  ?_Xj  »  E  ^(X-ElXj)*^ 


a*Tggffrtaag*ag»»sf; 
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X  =  Y 
pqr  pqr 


£>6<£ 
i  q  J 


are  indeed  distributed  according  to  the  half-normal  density 

Hx)<  «  Vg/^r  «T2  e*p<-X2/2CfZ),  X  >  0  i 

X£0. 


From  this  reault,  the  half-normal  variates  for  multi-level  experiments 
may  be  seen  to  be  essentially  equivalent  to  those  for  2P  experimental 
making  the  work  of  Daniel  1959  and  Birnbaum  1959  relevant  to  the 
■interpretation. 

■  r'  INTERPRETATION  OF  EXAMPLE,  We  shall  turn  now  to  the 
interpretation  of  the  example  given  earlier.  Some  difficulty  will  be 
experienced  because  of  our  ignorance  of  the  precise  nature  of  the  factors 
and  their  levels,  the  experimental  techniques  and  the  observations  them- 
selvae i  but  we  shall  attempt  to  proceed  along  lines  suggested  by  Daniel 
for  2P  experiments. 

To  recapitulate  the  results  of  Section  2,  we  have,  in  Table  7 ,  89 
ordered  variates  Xk*  ^pqr  whose  empirical  cumulative  distribution 

should  resemble  the  cumulative  half-normal  distribution  under  the 
hypothesis  that  there  are  no  treatment  effects.  We  have  plotted  these 
values  against  their  quantiles  in  Figure  l,|wherc  they  should  be  approxi¬ 
mately  linear  under  the  null  hypothetic. 

We  note  at  a  glance  that  the  plotted  points  are  markedly  and  systemati¬ 
cally  non-linear.  In  fact,  a  little  preliminary  geometrical  construction 
leads  us  to  believe  that  a  number  of  the  variates  are  too  large  to  have 
arisen  by  chance  under  the  null  hypothesis.  The  rationale  for  this. belief 
» s  *  s  Xs  How  Sr  Unde  r  the  null-  hypo  the  sis  ths  star,  dard  deviation ;  *2’.'*.  is. 


jR  —  r : — 

Ojij) )  p,  q.rji  0,0 
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directly  approximated  by  the  value  of  X  ,  wher*  11 

fn 


m  *  (0.683  n  +  0.  3), 

*  41,  approximately. 

From  Table  7,  —  .  ;  ....', 

Than,  under  the  null  hypothesis,  the  plotted  points  should  lie  near  a 
straight  line  through  the  origin  and  the  pdint  (Xm,  Pm),  indicated  in 

Figure  1.  Should  the  largest  X  lie  "for  enough"  to  the  right  of  this  line 
it  is  reasonable'  to  presume  that  it  did.  not  arise  by  chance  under  the  null  .  .. 
hypothesis..  It  may  then  be  taken  as  reaj  and  the  next  larg|st  X  promoted 
to  the  largest.  This  is  roughly  equivalent  to  increasing  the  ordinate  62 
the  second  point  to  that  o l  the  first  point/  Should  this  replotted  point  also 
lie  "far  enough"  to  the  right  of  the  line,  it  too  may  be  judged  real  and 
excluded,  promoting  the  next  X  to  the  largest,  etc.  In  Figure  1,  we  make 
a  crude  test  of  . the  largest  values  by  constructing  a  horizontal  through 
the  largest  point  to  intersect  the  previously  constructed  empirical  cu¬ 
mulative  distribution  line.  From  this  intersection  we  drop  a  vertical 
line  and  observe  that  all  contrasts  represented. by  points  lying  to  the  right 
of  this  vertical  would  have  to  be  excluded  before  the  Hugest  X  would  lie  on 
or  above,  the  original  e.  d.  lino.  Inthis  crude  mfcnn<^  : 

Figure  1  that  six  to  ten  of  the  largest  values  of  X  would  be  unllkely  to 
occur  under  the  null  hypothesis.  This  graphical  construction  is  no 
"exact"  test;  in  fact  it  is  rather  likely  that  one  or  more  contrast*  would 
he  judged  "reel"  in  this  manner  even  if  the  null  hypothesis  did,  in  fact, 
hold,  There  is  one  element  of  conservativiemin  this  procedure,  in  that 
the  plotted  c.  d.  line  is  based  upon  ail  contrasts,  while  a  c.  d.  line  based 
only  on  contrasts  not  judged  "regl"  at  this  stage  would  lie  to  the  left  of 
the  original  line.  -  -  - 

Let  us  tentatively  supjioee  that  the  ^ix  largest  contrasts  (Aj,  Aj, 

Cj,  Ag,  A^)  are  real,  considering  (after  Daniel  JV  3l,sJ  ) 

their  simple  name  s ,  as  well  as  their  magnitudes  relative  to  the  rest. of 
the  set.  We  plot  anew  the  53  remaining  contrasts  in  Figure  2,  Actually, 

In  addition  to  the  ten  largest  remaining  contrasts,  only  a  fraction  of  the 
point*  are  plotted,  together  with  the  c.  d.  line  through  (X  ,  F_,),  where 
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v  m  «  (0, 683)  (53)  +  0. 5,  ^ " 

=  37,  approximately.  , 

-  " "  '  ■  -T '  -  .  '  '  ■’/. 

The  values  nf  P  ar«.  of  couiia.  recalculated  for  n  *  53.  It  appear ■ 

""  ..  ..  ”  "  k  "  ■ 

reasonable  to  judge  from  this  plot  that  the  four  largest  contrasts 
AjCj,  Cjji  Aj|Bj)  are  real. 

A  final  plot  of  the  values  obtained  after  eliminating  the  ten  largest 
values  is  shown  in  Figure  3,  It  appears  in  this  plot  that  all  real  effects 
have  been  removed,  with  a  residual  error  standard  deviation  approximately 
equal  to". 


k34 


■  841 


(The  actual  mean  square  of  the  49  residual  contrasts  is  816;) 

Some  further  details  of  interpretation  might  he  attempted.  For  ex¬ 
ample,  there  is  a  suggestion  in  Figure  1  and  in  Table  7  that  there  may 
have  been  plot- splitting,  with  factor  B  applied  within  plots.  This  also 
appears  plausible  from  the  rudimentary  information  given  as  to  the 
nature  of  thi effector.  A  further  plotting,  not  shown  here,  in  which  con¬ 
trasts  including  Br  or  B,  were  separated  from  those  containing  BQ 
suggests  a  whole  plot  standard  deviation  Of  about  50-60  and  a  spli*“~ 
standard  deviation  of  about  20^25, 

5,  COMPUTER  USE.  We  have  used  half-normal  plots  for  multi¬ 
level  factorial  experiments  for  almost  two  years.  Our  first  major  attempt 
to  employ  this  technique  was  in  the  analysis  of  an  unreplicated  10  x  5  x 
3  x  22  experiment.  The  factor  level*  in  this  experiment  were  applied 
in  a  split -split -split  plot  design  and  certain  problem*  of  variance  hetero- 


.  !i..  ....  ~  . 


iju*  half_r*c plcttlsj  --  th.1  s  dsti  v?£ *  miff* * 


(jeiiQAvy 

ciently  informative  that  it  appeared  worthwhile  to  develop  a  program  for 
the  IBM  1620  to  he  employed  in  computing  half -normal  variates  from 
multi-level  factorial  data.  This  program,  Single  Degree  of  Freedom 
Analysis  of  Variance  (SXDOF),  has  a  capacity  of  eight  factors,  each  at 
two  to  tea  levels.  It  requires  as  input  the  observations  and  normalised 
vectors  of  contrast  coefficients  £X_,  $  -/  „>  etc. ,  where 
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= 


.  .  etc, 

....  •  ■  ; '  '  .  .  ;»  .  ■■  ; 

Each  factor  requires  ah  Additional  "pass'1  through  the  machine.  On  die 
first  pass,  the  machine  computes  the  quantities  (assuming  three  factors), 

<Vij*  ?  VhiJ* 

h 

On  the  second  pass  are  computed  the  quantities, 

(ApVj  ■  ?  A*  (ViJ 

ji  *  •  .* 

'  .  .  n  ■  ’  ...  • 

and  on  the  third  pass  the  quantities 

-  ’  f  V ,  •  '  " 

„  (ApBqCp)  =  £  tpJ  (ApBq)j* 

" 

V  .  ' 

At  each  pass  the  output  includes  both  the  (signed)  contrasts  developed  and 
their  squares.  This  program  was  one  of  the  first  developed  for  the  IBM 
IwSO  at  Dug  way  Proving  urouna  ana  consequently  was  employed  for  a 
short  period  of  time  as  a  general-purpose  analysis  of  variance.  (It  is, 
of  course,  much  slower  than  other  general-purpose  programs  available,  ) 
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6,  EXPERIENCE.  Some  general  comments  on  our  experiences  With 
half-normal  plots  for  multi-level  factorials  may  be  in  order.  Wa  shall 
be  guided  in  this  commentary  largely  by  the  approach  Of  Daniel  £l95'9j  . 

a,  Graph  Sheets,  We  have  generally  used  half-sheets  of  the  Prob¬ 
ability  Scale  x  90  Divisions  paper  available  from  Keuffel  and  Ester 
(Nos.  358-23  and  359-23).  *  Similar  papers  are  available  from  several 
other  sources.  These  papers  are  not  particularly  well-suited  to  the  pur¬ 
pose,  It  would  appear  that  special  half-normal  paper  might  be  commer¬ 
cially  feasible,  but  it  is. not,  to  our  knowledge,  currently  available, 

b,  Birnbaum's  test  statistic.  The  test  statistic  developed  by  v 
Allan  Birnbaum [  1959J  has  been  used  for  our  purposes.  Birnbaum's 
work  has  been  particularly  oriented  toward  2?  experiments  and  studies 
of  the  behavior  of  this  statistic  in  multi-level  factorials  would  be  useful. 

c,  Defective  values.  Daniel  indicates  the  utility  of  half-normal 
plotting  in  2P  experiments  for  detecting  defective  values.  For  multi¬ 
level  factorials  the  presence  of  defective  values  appears  more  difficult 
to  diagnose,  particularly  with  unrestricted  sets  of  orthogonal  contrasts. 
The  isolation  bf  the  particular  defective  values  is  also  more  difficult,' 

d,  HOt- splitting.  The  effect  of  plot -splitting  upon  the  halfpnprmal 
plots  for  multi-level  experiments  is  similar  to  that  described  by  Daniel. 
We  have  some  reservations  concerning  indiscriminate  searches  for  plot- 
splitting,  however.  It  is  generally  accepted  that  in  most  experiments 
two -factor  interactions  tend  to  be  smaller  than  main  effects,  three- 
factpr  Interactions  tend  to  be  smaller  than  two-factor  interactions,  etc, 
(Here  we  are  speaking  of  real  effects  and  interactions,  though  perhapi 
of  negligible  magnitude. )  Thus  in  actual  experiments  the  slope  of  half- 
normal  plots  may  be  expected  to  increase  with  the  relative  number  of 
high  order  interactions  included,  The  plotted  results  of  an  experiment 
involving  a  number  of  small  but  real  interactions  may  appear  very  simi¬ 
lar  to  the  results  induced  by  plot- splitting,  since  split  plot  error  con¬ 
trasts  invariably  contain  a  relatively  larger  number  of  the  higher  order 

.  ....  -  ;  „  •  —9  •  '  "  '  '  1  ’  ’ 

uu  1  /  1 

’The  graph  sheets  used  in  Figures  1;  2,  and  3  were  reproduced  from 
a  master  kindly  provided  by  Mr.  Daniel.  It  is  hoped  that  such  sheets 
will  soon  be  published, 
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contrasts.  Our  practice  is  generally  to  employ  a  split  plot  analysis 
only  when  knowledge  of  the  experimental  techniques  indicates  its  pro¬ 
priety. 

e,  Convexity  of  plots.  The  detection  of  antilognormal  distribution 
iof  error  by  downward  convexity  of  half-normal  plots  appears  difficult, 
as  indicated  by  Daniel  p.9 59,  p.  336  J.  Most  of  our  analysis  wpfk  is, 
however,  based  on  transformed  data  and  we  have  seldom  experienced 
this  particular  anomaly,  In  any  event,  the  averaging  effect  of  the  con¬ 
trasts  would  presumably  minimise  the  effects  of  non-normality  of  error, 
On  the  other  hand,  we  have  noted  that  the  removal  of  a  moderate  number 
of  points  representing  apparently  real  effects  often  results  In  a  downward 
convexity  of  the  ppper  portion  of  the  plot.  We  generally  attribute  this 
appearance  to  the  inadvertent  removal  of  one  or  more  points  representing 
error  contrasts,  for  the  result  looks  very  much  like  the  plot  of  a  normal 
distribution  with  truncated  upper  tail, 
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PROPORTIONAL  FREQUENCY  DESIGNS 
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CONDITION  OF  EQUAL  FREQUENCIES  .  In  1945  Finney  [5]  intro¬ 
duced  the  procedure,  known  as  fractional  replication,  which  permitted  the 
uncorrelated  estimation  of  some  of  the  effects  and  interactions  when  only 
a  fraction  of  the  full  factorial  arrangement  was  used.  The  standard  method 
of  constructing  fractional  replicate  plans  id  to  first  choose  an  identity  re¬ 
lationship  and  then  deduce  from  this  relationship  the  appropriate  treat¬ 
ment  combinations.  By  utilising  the  assumption  that  the  higher  order  inter¬ 
action  effects  are  negligible  this  standard  procedure  permits  the  esti¬ 
mation  of  the  remaining  effects.  For  the  symmetrical  factorial  structure 
(all  factors  having  the  same  number  of  levels)  the  standard  procedure  yieldsi 
uncorrelated  estimates  due  to  the  condition  of  equal  frequencies  of  the 
factor  levels.  If  the  treatment  combinations  of  the  2^  factorial  plan  ware 
Inspected  one  would  find  that 

(1)  Each  level  of  every  factor  occurs  exactly  eight  times  with  every 
level  of  any  other  factor. 

(2)  Each  cbmblnation  of  levels  of  any  factor  occurs  exactly  four  times 
with  every  combination  of  levels  of  each  pair  of  factors. 

(3)  Each  combination  of  levels  of  any  pair  of  factors  occurs  exactly 
two  times  with  every  combination  of  levels  of  any  other  pair  of  factors. 

(4)  Each  level  of  any  factor  occurs  exactly  two  times  with  every  com¬ 
bination  of  levels  of  any  three  factors. 

(5)  Each  level  of  any  factor  occurs,1)  exactly  once  with  each  combin¬ 
ation  of  levels  of  any  four  factors. 

(6)  Each  combination  of  levels  of  any  pair  of  factors  occurs  exactly 
once  with  every  combination  of  levels  of  any  three  factors. 

Because  the  condition  of  equal  frequencies  is  satisfied  for  all  six 
of  the  above  cases  unco r related  estimates  of  all  effects  can  be  obtained. 

Nov/  consider  a  1/ 4  replicate  of  the  2  factorial  structure  defined  by 
the  identity  relationship 

1  =  ADE  =  BCD  =  ABCE 
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and  consisting  of  the  following  treatment  combinations; 
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One  can  verify  that  in  this  plan  each  level  of  any  factor  occurs 
exactly  twice  with  every  level  of  any  other  factor,  and  hence  uncorrelated 
estimates  of  all  main  effects  are  obtainable,,  If  all  interactions  are  negli¬ 
gible.  It  can  also  be  verified  that  each  level  of  a  factor  does  not  occur 
the  same  number  of  times  with  every  combination  of  levels  of  those  pairs 
of  factors  with  which  it  is  aliased,  Hence  not  all  main  effect  estimates  are 
uncorrelated  With  two-factor  interaction  estimates. 

When  one  wishes  to  construct  fractional  replicate  plans  for  symmetri¬ 
cal  factorial  arrangements  one  need  only  satisfy  the  appropriate  equal 
frequency  conditions  to  obtain  uncorrelated  estimates  of  the  effects. 
However,  in  the  construction  of  fractional  replicate  plans  for  asymmetri¬ 
cal  factorial  arrangements  (all  factor*  not  having  the  same  number  of 
levels)  the  condition  of  equal  frequencies, requires  more  treatment  com* 
binatione  th<m  are  necessary  to  yield  uncorrelated  estimates, 

CONDITION  OF  PROPORTIONAL  FREQUENCIES  .  Although  the 
equal  frequency  condition  is  sufficient  to  guarantee  orthogonality  of  fac¬ 
tors  it  is  not  a  necessary  condition.  It  was  proved  by  Adds  1  man  and 
Kempthorne  13]  that  a  necessary  and  sufficient  condition  that  the  main 
effect  estimates  of  two  factors  be  uncorrelated  is  that  the  levels  of  one 
factor  occur  with  each  of  the  levels  of  the  other  factor  with  proportional 
frequencies.  Consider  two  factors,  A  and  B,  occurring  at  r  and  e 
le.yels  respectively.  Let 

N  =  number  of  treatment  combinations  in  the  plan 

n,=  number  of  times  the  i  level  of  factor  A  occurs 
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n  .  =  number  of  times  the  j  level  of  factor  B  occurs 


n.  =  number  of  treatment  combinations  in  which  the  i  level 
^  of  factor  A  occurB  with  the  j  level  of  factor  B. 

The  above  necessary  and  sufficient  condition  f dr  orthogonality  can  be  dis¬ 
played  mathematically  as 


ni. n 


The  condition  of  proportional  frequencies  can  he  generalised  so  that 
plans  may  be  constructed  with  permit  uncorrelated  estimates  of  two  - 
factor  interactions  as  well  as  main  sffscts.  Consider  three  factors  A, 

B  and  C,  In  order  that  the  interaction  AB  can  be  uncorrelated  with  C, 
each  combination  of  the  levbls  of  A  and  B  must  occur  with  the  levels  of 
C  with  proportional  frequencies,  that  is 


Since  it  la  desirable  that  A  be  uncorrelated  with  B 


and  hence 

W  n,Jk  -  n1..»j.»  .k/N2  . 


This  condition  which  assures  that  AB  is  uncorrelated  with  C  also. im¬ 
plies  that  AC  is  uncorrelated  with  B,  BC  uncorrelated  with  A,  and  hence 
AB,  AC  and  BC  are  pairwise  uncorrelated.  If  a  plan  contains* four  or 
more  factors  condition  (4)  must  be  replaced  by 


nijkm 


which  is  the  necessary  and  sufficient  condition  that. a  plan  permit  un¬ 
correlated  estimation  of  all  main  effects  and  two-factor  interaction  effects. 
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COLLAPSING  OF  LEVELS.  A  factor  at 's  levels  may  be. collapsed 
to  a  factor  at  <  s^  levels  by  making  a  many-one  correspondence  of  the 
Set  Of  s.  levels  to  the  set  of  a,  levels.  If  s,  =.  s™  then  the  s,  levels  can 

l  •  4  •  1  4  1  . 

he  collapsed  to  (s^-IJ/^Sg-l)  factors  each  having  s^  levels.  Some  illus¬ 
trations  of  typical  correspondence  schemes  are  presented  below. 
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• '  . .  v  2  2  '  *•' 

An  orthogonal  main-effect  plan  fori  the  2  x  3  experiment  which  per¬ 
mits  uncbrrelated  estimates  of  all  main  effects  with  only  nine  treatment  com¬ 
binations  is  now  constructed  to  illustrate  the  technique  of  collapsing  levels. 
First  construct  an  orthogonal  main-effect  plan  for  four  factors,  each  having 
three  ievelewith  nine  ..treatment  combinations,  namely  . 
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If  each  of  tho  first  two  factors  are  collapsed  totwo-lsvsl  factors, 
the  resulting  treatment  combinations  constitute  an  orthogonal  main* 
effect  plan  for  the  2Z  x  3Z  experiment  and  are  displayed  below. 
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It  should  be  mentioned  that  the  proportional  frequency  condition  will 
be  satisfied  no  matter  what  type  of  correspondence  scheme  is  used  to 
perform  the  collapsing  procedure.  However,the  efficiency  of  the  eftir 
'mates  depends  upon  the  pijsrtlcular  correappndenoe  schenje  chosen.  ' 


If  the  (s^  -  1)  degrees. of  freedom  for  each  of  the  t^  factors  at  s^ 
levels, are  represented  by  (si  -  i)  orthogonal  contrasts  among  the  ^ 


levels,  the  estimates 
with  the  estimates  obtained  with  the  contrasts  for  any  other  factor,  be* 
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cause  the  correspondence  scheme  automatically  guarantees  proportional 
frequencies  of  the  levels  of  each  factor, 

REPLACING  FACTORS  .  The  collapsing  procedure  given  above  can 
be  reversed  so  that  a  factor  at  sm  levels  can  replace  (sm  -  l)/(s  - 1)  fac¬ 
tors,  each  at  a  levels.  The  replacement  procedure  can  be  illustrated 

■ '  ,  1  '  4 

by  the  construction  of  an  orthogonal  main-effect  plan  for  the  3x2  ex¬ 
periment  with  eight  trials.  First  construct' an  drtho'gonai  main-effect 

■■■  "  7 

plan  for  the  2  experiment  with  eight  trials',  The  seven  two-level  fac¬ 


tors  can  be  represented  by  X^,  X^,  XjX^*  X, 
The  treatment  combinations  for  this  plan  are 


X1X3* 


X,X.  and  X,X,X4 
2  3"  12  3. 
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It  is  known  that  there  exists  an  orthogonal  main-effect  plan  for  the '2* 
experiment  with  four  trials,  The  treatment  combinations  for  this  plan 
are  OOO,  Oil,  lOl,  and  liO,  Thus,  by  choosing  three  factors  of  the  2? 
plan  whose  X  representations  are  such  .that  the  generalised  inte  raction 
of  any  two  of  the  three  factors,, is  the  third  factor,  three  two-ievel  fac¬ 
tors  can  be  replaced  by  a  four-level  factor,  according  to  the  following 
correspondence  scheme: 


.  -  li 
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Two-level 

Four-level 

factor 

factor 

O  O 

O  — 

- > 

O 

O  1 

1  - - 

- — > 

1 

1  O 

1  — — ■ 

- > 

2 

1  1 

O - 

- - ~> 

3 
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Since  the  X  representations  of  the  first  three  factors  of  the  above  plan 
are  X.,  ■  X,  and  X,X,(  these  three  factors  can  be  replaced  by  a  four-level 

factor  and  the  orthogonal  main-effect  plan  for  the  4  x  2  experiment  in 
eight  trials  is  given  by  the  following  treatment  combinations; 


0 

0 

0 

0 

0 

0 

1 

1 

1 

1 

1 

O 

0 

1 

1 

1  . 

1 

1 

0 

0 

2 

O 

1 

0 

1 

2 

1 

0 

1 

0 

3 

O 

1 

l 

0 

3 

1 

0 

0 

1 

The  plan  for  the  3  x  2*  experiment  is  than  obtained  by  collapsing  the 
four-level  factor  to  a  three-level  factor  by\i the  correspondence 

Four-level  Three-level 

factor  factor 


0  -*>  O 

1  - - - ->  1 

2  - >  2 

3  >  1 


The  smallest  plan  which  yields  uncorrelated  estimates  of  main 
effects  in  the  3x2*  experiment  and  which  also  satisfies  the  equal  fre- 
qucncy  condition  would  ic’iqaito  24  treatment  combinations* 


The  procedure  for  constructing  plans  which  permit  unco  r  related  esti 
mates  of  all  main  effects  and  some  or  ail  of  the  two-factor  interaction 
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effects  for  asymmetrical  factorial  arrangements  consists  of  first  con- 
structing  the  corresponding  plan  for  a  symmetrical  factorial  arrangement 
and  then  utilizing  the  collapsing  or  replacing  techniques  to  obtain  the  de¬ 
sired  plan.  Whereas  a  plan  permitting  uncorrelated  estimates  of  all 
main  effects  and  all  two -factor  interactions  among  the  .two -level  factors 

in  the  2*  x  3^  experiment  would  require  72  treatment  combinations  to 
satisfy  the  condition  of  equal  frequencies  it  would  only  require  27  treat¬ 
ment  combinations  to .  satisfy  the  proportional  frequency  condition. 

BLOCKING.  Even  though  the  proportional  frequency  designs  are 
highly  fractionated  they  may  still  require  more  trials  than  can  be  carried 
out  under  uniform  conditions.  Thus,  it  would  be  desirable  to  divide  the 
experimental  data  into  smaller  blocks  in  such  a  manner  that  the  main 
effects  may  still  be  estimated  without  correlation.  In  order  to  perform 
an  experiment  in  blocks  one  may  utilize  one  or  more  of  the  factors  of  an 
orthogonal  main-effect  plan  for  the  4  x  32  x  2b  experiment  with  sixteen 
trials.  The  following  plans  may  be  derived  from  this  one  by  using  various 
factors  as  blocking  factors; 

2  5 

(i)  4x  3  x  2  in  2  blocks  of  8  treatment  combiantions, 

2  3 

(U)  4  x  3  x  2  in  4  blocks  of  4  treatment  combinations, 

(ill)  3  x  2  in  4  blocks  of  4  treatment  combinations, 

( iv)  4.x  3  x  2^  in  4  blocks  of  4  treatment  combinationo. 

i,  "  .  ...  ..  '  i  ... ..  .  v  .V'  ,  y„: 

ORTHOGONAL  POLYNOMIALS.  The  orthogonal  contrasts  which  de* 
fine  effects  and  interactions' in  an  equal  frequency  design  can  lie  readily 
determined  from  a  table  of  orthogonal  polynomials,  The  advantage  of 
using  orthogonal  contrasts  to  define  effects  and  interactions  arises  from 
the  fact  that  orthogonal  polynomials  are  so  constructed  that  any  term  of 
the  polynomial  is  independent  of  any  otherterm.  This  property  of  in¬ 
dependence  permits  one  to  compute  each  regression  coefficient  inde¬ 
pendently  of  th$  others  and  also  facilitates  testing  the  significance  of 
each  coefficient. 

Title  s  of  crihbgcnSri  pel y  iimiilil » •  fo r  ir.e  c»se  oi  equally  spaoea  levels 
are  readily  available t  e.  g.  Fisher  and  Yates  [6]  .  Anderson  and  Houseman 
UJ ,  It  would  be  an  impossible  task,  to  compile  a  general  table  of  orthogoral 
polynomials  for  unequally  spaced  levels.  However  a  simple  procedure  for 
computing  these  orthogonal  polynomials  is  available  and  will  be  presented 


Design  of  Experiments  295 

below.  If  equally  spaced  levels  do  not  each  occur  in  a  plan  an  equal  num¬ 
ber  of  times  the  published  tables. of  orthogonal  polynomials  are  not  appro¬ 
priate.  The  orthogonal  polynomials  for  equally  spaced  levels  which  do  not 
occur  in  a  plan  with  equal  frequency  can  be  computed  by  the  following  method 
for  unequally  spaced  levels. 

■"  For  any  set  of  orthogonal  polynomials  the  linear  contrast  is  of  the  form 
2{a  +  £x)yx<  where  a  and  |J  are  constants,  x  is  the  level  at  which  the 

factor  occurs,  y^  is  the  response  to  the  treatment  combination  with  the 

factor  at  the  x  level  and  the  summation  is  over  every  value  of  x  which  is  , 
presented,  The  quadratic  and  cubic  contrasts  are  of  the  form  Z(a  +  (3x  +  yx  j  y 

And  2(a  +  (3x  +  yx  +  'fix  )y  ,  respectively,  The  extension  to  higher  order 
contrasts,! Is  obvious.  Two  contrasts  are  orthogonal  If  the  coefficient*  of 
each  contrast  sum  to  zero  and  the  sum  of  products  of  the  corresponding 
coefficients  of  the  two  contrasts  is  zero. 


Table  1 


Coefficients  of  Orthogonal  Contrasts 


Level  of 

’■■■■  '■ 

Linear 

'  Quadratic  . 

Cubic 

o 

.  .  .  .... 

-  '  ;f  '- ■ 

r.  ; 

1 

r+  # 

1  +  v  47 

4$  H 

¥/:.  +'• 

2  ' 

.  X  +  2  " 

Y  +  2p  +  4? 

•  +  2 $ 

+  4*y  +  8  6 

4 

:  ■  :(  +  4  (: 

7  +  40  +  1  67 

+  40 

+  167  +  64* 

We  will  illustrate  the  procedure  for  obtaining  orthogonal  polynomials 
for  unequally  spaced  levels  with  an  example.  ii 


Goftaidc^ltn  ihaepem^  With  ievels  0,  1,  2  and  4.  The 

coefficients  of  the  linear,  quadratic  and  cubic  contrasts  for  this  example 
are  displayed  in  Table  1.  The  coefficients  of  the  linear  contrast  must  sum 

to  zero.  Thus, 


4 <*,+  70  ■  0.  -  7  ; 

Setting  ft  si  we  find  that<?  =  -7/4,  In  order  that  the  coefficients  of  the 

o  rthnfffln  a!  r'nnf  ffi  of  a  Kb  ^UnaMa  «i.  *»•*-*> 

- — - *—  *'*'  »  -  «  vwuveu  vw  iWtTC  Ht  tVi  Uip  W O  f I1U* ViJJAy  VUtf 

coefficients  by  4  to  obtain,  p  ■  4  and  qf  =  -7.  Substituting  d  •  .»?  and/5  “  4 
in  the  linear  contrast  given  in  Ta.bl^  1, 'gives  the  linear  coefficients, 


Design  of  Experiments 

.:-  •'  ii  ., 

••  H  ‘  r  ••  '  •■  .  i.  •  '•■ 

Devil  of  Coefficient  of 

x  linear  contrast 

\  1  :  0  ,„  ■  .  |  '  -7  .. 

1  i  "  '  5  ■"  .  -3  •  - 

2  1  ."  .. 

4  9 

The  coefficients  of  the  quadratic  contrast  mult  sum  tp  zero.  Hence, 

"  4  C+  Ip  +  21’y  *  9  ■  '  / 

The  sum  of  products  of  the  corresponding  coefficients  of  the  linear  and 
quadratic  contrasts  must  also  equal  aero.  Thus, 

V’%,  ,  +i4'|y  so  •,  ■■■ V^v! 

Solving  these  two  equations  to  obtain  integral  vliiupV'fd# .  p#  -|uidy  WC ' .. 
Obtain  f  a  14, /*  ■  -Z9  and  y  »  7, 

If  we  substitute  these  values  in  the  quadratic  contrast  and  reduce  the 
resulting  coefficients  to  lowest  terms  the  coefficients  of  the  quadratic 
contrast  is  given  by 


Level  of 


Coefficient  of 
Quadratic  contrast 


Similarly  the  sum  of  the  coefficients  of  the  cubic  contrast  and  the  sum 
Of  products  of  the  corresponding  coefficients  of  the  linear  and  cubic 


contrasts  must  each  equal  zero.  Hence, 

4  a  +.  7  +  21  y  +  73*  =0 

,V_;'  „  "  ’  +  14&y.+  'Ml-tf  *0 

44y  +  252  5  “0 

Solving  these  equations  to  obtain  integral  values  for  Q,  £  ,  y  and  we 
obtain  flj  =  -36,  =  392,  y  “  -315  and  $  *  55.  If  we  substitute  these 


-I 

■  ...  ..  .  ,1 
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values  in  the  form  of  the  coefficients  of  the  cubic  contrast  given  in  Table  1 
and  reduce  the  resulting  coefficient  a  to  lowest  terms,  the  coefficients  Of 
the  cubic  contrast  are  given  by 

Level  of  «  •  Coefficients  of 

'  . Cniffi. , 

...  I  q  "i  .  . ,  ... 'i.lii.j.....:. _ _ , . 1  ' 

I!  1  r  y  .  8 


The  orthogonal  polynomials  are  presented  in  the  following  table. 


Table  2 

Orthogonal  Polynomial  a 


Level  of 

■  Linear 

Quadratic 

Cubic 

O'  "  ■ 

-  «7  • 

•  -•%  r 

1  . 

2 

=■■  48  • 

1 

,  -4-:  4:> 

■  :  i.SK',' 4  ::::: 

'»i(-  -•  “■ 

v  i 

9- V:'. 

... _ -_ej -1^ 

Tite  symbol’li^  tepresenta-^one^uhltn^thi  linear  effect  of  n-fiqfor  When 
set  equal  to  unity.  In  Order  to  obtain  integral  Coefficients  8  tea  eet  equal 
to  4  and  &enee(i/4J  represents  one  unit  of  the  linear  effect.  Consequently 
the  linear  contract  with  coefficients  given  in  Table  2  represent*  #ie  eatl- 
mate  of  l/4  the  linear  effect  of  the  factor,  It  is  easily  verified  that  the 
coefficients  of  the  quadratic  contrast  are  given  by 


11 
2  " 


7  2 
x  +  “•  Jr; 

"A 


where  x  =  0.  1.  1  end  4  respectively.  Thus  the  symbol  represents  one 
unit  of  the  quadratic  effect,  and  the  linear  contrast  with  coefficients  given 
in  Table  2  represents  the  estimate  of  1  the  quadratic  effect  of  the  factor. 
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Similarly  it  may  be  demonstrated  that  the  cubic  contrast  with  coefficients 
given  in  Table  2  represents  the  estimate  of  12/55  the  cubic  effect  of  the 
.factor,  ■; 


This  constant  which  is  multiplying  each  effect  will  be  denoted  by  l/A 
and  in  the  tables  of  orthogonal  polynomials  presented  by  Addelman  and 
Kempthorne  [il  the  value  of  X  and  the  sum  of  squares  of  the  coefficients 
were  both  given.  Any  contrast  defined  by  the  coefficients  given  in  the 
table* .of  orthogbnal  polynomials  represents  l/X times  the  appropriate 
effect  of  the  factor.  1  .  i 

,  -  EFFICIENCIES.  Although  any  many-one  correspondence  of  the  set  of 
Sj  level  I  to  the  set  of  s^  levels  will  yield  proportional  frequencies  of  the 

levels,  there,  arises  the  problem  of  which  correspondence  is  "best"  in  some 
sense.  The  problem  may  be  solved  by  determining  the  efficiencies  of  the 
main-effect  estimates  obtained  using  proportional  frequencies  relative  to 
the  estimates  which  would  result  from  using  equal  frequencies  of  the  levels 
'  of  each  factor,  r 

As  an  illustration  we  will  calculate  the  relative  efficiency  of  a  three  - 
level  factor  in  a  main-effect  plan  with  twenty-five  trials, 

-  Assume  the  corre.sppndence'icheme  five-l'IVd^fafitpr- 

to  three  leyble  1*  *«  followas  :  " 


Five-level 

factor 

:  0 

:  S-  1  ' 

2 

V  -  3  •: 

4 


Three -level 

factor  -  - 

->  o  ' :  ' 

-?>  1 

»$»-’■  2  ■ 

— >  2  . 

— o 


The  levels  0,  l,  and  2  occur  in  the  ratio's  2;  1:  Z,  Thus  for  this  factor 
the  0  level  occurs  in  ten  treatment  combinations,  the  1  level  occurs  in  five 


treatment  eomoxantxana  anumt 
tion* . 


<■»  V'  T  Xmmm.-*.  2  —  MAVMVlitttt'-. 

ft  level  WVWMVO  A»a  wt*  *,*-w 


The  variance  of  the  linear  effect  estimate  of  this  factor  is  equal  to 


■ .)» 


4  ■ 

IX 
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o'  / 20  and  hence  the  information  on  .a  unit  basis  is  equal  to  20/25*'^  =  4/5 
The  variance  of  the  linear  effect  estimate  of  a  three -level  factor  in  3* 
t0,&  /2‘ 3”~  and  the  information  on  a  unit  basins 
■  /3  v  *  Z/Iq  ,.  Hence  the  relative  efficiency  of  the  linear  effect 

estimate  is  equal  to  (4/5)x(3/2)  =  6/5.  >  . 

The  variance  of  the  quadratic  effect, estimate  for  the  three-level 
:{*m  w  equal  to  {/‘/A  and  the  infematioii  ie  then 

eq,u,  to  4/25<X  The  variwice  of  the  quadratic  effect  estimate  with  3n 
trials  is  equal  tp  cr  /2.  3  and  hence  the  information  on  a  unit  basis 

}“  JgjyW**  ;  T1?!  /A wiv?  «£flci«ncV  «*  the  quadratic  effect  estimate 
is  therefore  equal  to  (4/25)x(9/2)  ■  18/25, 


■ 


'•  * v  it.*.  ■  .  -  /.nih-n  ■ 


i'i 


its 


Table  3 

Relative  Efficiencies  oi  Proportional  Frequency  Eaclaataa 


Level 


Laval 

OotlttMt 

Linear 

Quadratic 

Linear 

Quadratic 

Llnaar  . 

Quadratic 

Linear 

Quadratic 

Linear > - 

Quadratic 

Linear 

Quadra file 


0'  i  .v 

Proportional  frequency 


Efficiency 


1 

2 

1 

3 

2 

1 


2 

3 

4 

4 

5 
A 


0  1  2 

Proportional  frequency 


1  1 

2 

»  X 

3/4 

1  I 

2 

1  I 

9/8 

2  i 

1 

i  ft 

6/3 

2  1 

t 

t  ft 

18/ftS 

1  ! 

3 

»  1 

_  -  ■ 

v:vf •'  ; 

3/S 

1  ! 

3 

ii 

"  ii  • 

27/29 

2  1 
2  t 

J 

3 

IS 
f  2 

\.  i!-  , 

M 

1!  1 

1 

t  3 

9/7 

it  t 

1 

r  3 

27/49 

i  t 

5 

I  1 

3/7 

1  t 

5 

t  1 

43/49 

V 


..-i 
' .  r - 
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The 


30] 


are  presented  for 
3,  One  would  choose  the  pro* 
portional  frequencies  which  give  the  greatest  efficiency  of  estimate*. 
:'T^*vfo-r*x*mplej  ifjmexpefiment  in  twenty-five  trial*  Involved  two* 
level  factor*  the  two  levels  should  occur  in  the  ratio  Z  i  3  father  than 
in  the  ratio  !  ;  4  because  the  efficiency  of  the  2  ;  3  ratio  i*  24/25 
whereas  the  efficiency  of  the  1  s  4  ratio  is  only  16/23. 


V 
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OPTIMAL  DESIGN  OF  EXPERIMENTS 

Herman  Chernoff  — ^ 

Stanford  University 

1.  INTRODU  CTION.  X  would  like  to  discuss  some  aspects  of  the 
theory  of  optimal  design  of  experiments  with  particular  emphasis  on  its 
relevance  to  the  practice  of  statistics.  There  are  two  major  branches 
of  classical  statistics,  Estimation  and  Testing  of  Hypotheses,  for  which 
the  theory  of  optimal  design  yields  different  results.  Because  of  the 
time  limitation,  I  shall  confine  my  attention  to  certain  results  and  ex¬ 
amples  in  the  theory  of  estimation. 

2,  SOME  EXAMPLES.  To  illustrate  the  theory  let  us  consider 
three  examples.  The  first  example  is  a  well  known  one  with  a  trivial 
solution.  That  is  the  one  of  estimating  the'  slope  of  a  regression  (straight 
line).  More  specifically  we  have 

Example  1. 

The  experimenter  may  choose  any  number  y  between  >1  and  41. 

This  number  y  designates  an  elementary  experiment  whloh  corresponds 
to  observing 

Z  «  06  +  £  y  +  u 

where  u  .is  normally  distributed  with  mean  0  and  variance  1  and 
and.  $  are  unknown  parameters.  The.  experimenter  is  permitted  to 
■elect  a  da  elan  consisting  of  n  values  y^,  y2,  .  .  , ,  yn«  with  pos¬ 
sible  repetitions.  The  design  corresponds  to  performing  the  n  designated 
experiments  independently.  It  is  desired  to  select  a  design  which  will 
yield  the  best  possible  estimate  of  the  slope  (3. 

It: is  well  known  and  it  is  intuitively  obvious  that  the  best  design  con¬ 
sist*  of  selecting  y  ■  -1  and  y  >  +1  each  half  die  time  (providing  n  is 

even).  “ 


—  This  work  was  Supported  in  part  by  Office  of  Naval  Research  Contract 
Nonr-225(52)  at  Stanford  University.  Reproduction  in  whole  or  in  part 
is  permitted  for  any  purpose  of  the  United  States  Government, 
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Another  example  which  is  of  some  Current  interest,  having  bean  dis- 
cussed  in  yesterday's  paper  by  Mr,  Langlie  [si  on  a  problem  In  reliability, 
and  which  is  also  relevant  to  the  problem  of  Probit  Analysis,  may  be  ex¬ 
pressed  as  follows# 

Example  2.  ^ 

.  ■  .  .  '  y’  '  i 

A  device,  Which  may  be  used  only  once,  can  operate  successfully 
under  a  stress  s  with  probability 


<r 


In  other  words  one  may  say  that  the  strength  of  the  device,  a*  measured 
by  the  maximum  stress  under  which  It  will!  operate  successfully,  is 
normally,  distributed  with  unknown  mean  /U.  and  variance  0"*,  It  is 
desired  to  select  a  design  consisting  of  the  choice  of  ■tree#  levels 
■j,  *2i  .  .  . ,  sn  which  will  yield  an  optimal  estimate  of  ,A<  -  k<r  ,  The 

elementary  experiment,  designated  s,  consists  of  course  of  observing 
the  success  or  failure  of  the  device  when  ussd  under  strife  s# 

Finally  a  third  problem  which  was  discussed  in  detail  in  a  reeint 
paper  of  mine  [z]  deals  with  accelerated  life  testing,  Here  we  wish  to 
eatimate  the  meenlife  time  of  a  device  when  used  under  an  environment 
.  of  ordinary  stress  conditions.  If,  this  mean  lifetime  is  great  and  it  is 
desired  to  have  the  estimate  soon,  then  .it  is  necessary  to  accelerate,  v‘;; 
The  device  is  subjected  to  a  much  larger  than  ordinary  stress,  The  ' 
results  of  such  accelerated  life  testing  can  be  relevant  only  if  one  assumes 
some  form  of  relationship  connecting  the  mean  lifetime  under  various  . 
stresses;  As  an  approximation  we  shall  assume  a  quadratic  relationship 
for  some  limited  range.  In  addition  since  time  is  of  the  essence  we 
shall  assume  that  the  coat  of  observing  a  device  under  stress  •  is  pro¬ 
portional  to  the  mean  lifetime  under  that  stress.  I#at 


r 


w 


s.  -  - 
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A  device  under  stresa  environment  s  has  lifetime  T  with  an  ex¬ 
ponential  distribution  with  failure  rate  (reciprocal  of  mean)  given  by 


<P  *  fflB+  ei%t 


for  0  <,  a  <£  s# 


where  6?^  and  ^  are  unknown  parameters, 
the  failure  fate  under  the  ordinary  stress  s0< 


Pc 


Vb 


An  elementary  experiment  designated  by  s  consists  of  observing  the 
lifetime  T.  of  a  device  subjected  to  the  environment  8.  The  cost  of  the 
experiment  s  is  !!• 


C(s)  •  c(  + 


678z) 


■1 


It  is  desired  to  select  a  design  consisting  of  experiments  s^,  s^ 


I  •  •  •  » 


01  s^.*, 
total  cost. 


so  as  to  obtain  an  optimal  estimate  of  <p  for  a  specified 


!l  « 


It  is  desired  to  estimate 
This  is 


Each  of  these  examples  has  certain  elements  in  common.  Each  may 
be  regarded  as  a  special  ease  of  the  following  general  formulation,  There 
is  a  set  $  of  available  elementary  experiments  a.  In  each  case  the 
distribution  of  the  data  of  an  experiment  depends  on  the  experiment  and 
on  k  unknown  parameters  represented  by  &  ■  (  Q  ,  <  •  •  > 

We  wish  to  estimate  some  function  g(  of  the  para- 


c, ,  ejj. 


consists  of  ths  independent  poi^unnmico  of  experiments 


e 2'  ,  ,  with  possible  repetitions.  It  is  desired  to  find  a  design  which 
yields  the  best  possible  estimate  of  g(  0^ ,  & .  .  . ,  @  for  a  speci¬ 
fied  total  cost  or  for  a  specified  number  of  observations. 


* 


|f| 

If;. 
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3.  THE  UNEAR  REGRESSION  MODEL.  In  1$5 1,  Elfving  derived 
an  elegant  geometric  solution  to  the  optimal  design  problem  for  a  special 
but  important  case  of  the  above  general  formulation,  As  we  shall  see 
this  result  is  applicable  to  a  large  variety  of  problems.  Let  5  be  a  set 
of  experiments  e  denoted  by  (yj ,  y 2).  The  experiment  e  consists  of 
observing 

Z  *  ^yj  +  #2y2  +  u 

where  u.:  is  normally  distributed  with  mean  0  and  variance  1.  It  is 
desired  to  obtain  an  optimal  estimate  of  aj  (3j  +  a2  f?2  using  a  design 

consisting  of  n  observations.  The  first  example  of  estimating  the  slope 
of  a  straight  line  is  a  special  case  of  Elfving' a  linear  regression  model 
where  $  is  the  set  of  points  (1,  y)  with  and  (ipi/j,)  s  (0,1). 

Elfving'*  solution  consists  of  constructing  a  set  S  which  is  the 
smallest  convex  sat  containing  the  points  (y^,  y2)  of  jt  and  their  nega¬ 
tives  (-yt  ,  -yjj),  Then  extend  the  vector  from  (0,  0)  to  (a^sg)  until  it  ' 
penetrates  the  set  S.  The  point  of  penetration  (wj ,  w2)  represents  the 
optimal  design,  If  this  point  is  one  of  the  original  points  (yj,  y2)  or 
<-yr  -y2)  the  optimal  design  consists  of  repeating  (y  ,  y2)  n  times. 

Otherwise  the  point  of  penetration  is  on  a  line  segment  connecting  points 
corresponding  to  two  of  the  original  experiments  (or  their  negatives). 

Then  the  optimal  design  consists  of  repeating  these  two  [experiments  in 
proportions  given  by  the  distances  from  (wj,  w2)  to  the  two  points.  The 
greater  proportion  corresponds  to  the  experiment  closer  to  (w^,  w2). 
Finally  the  variance  of  the  least  squares  estimate  based  on  this  design  is 

~2  r  i  2  ,  2.-\  „i,  2  L  2.  2,  2  2 

0^-  *  [a(Wj  i  w2)J  (alJ+ Ij).*  &l/wl  “.a2/nw2 

This  solution  can  be  illustrated  with  example  1,  Here  S  is  the 
square  whose  corners  are  (1,1)  and  (-1,  -1)  corresponding  to  y  *1  and 
(1,  -1)  and  (-1,  1)  corresponding  to  y  a  -1.  The  line  from  (0,0)  through 

*  (0>  1)  penetrates  S  at  (0,  1)  which  is  halfway  between  (1,  1) 
and  (-1, 1).  Thus  the  optimal  design  consists  of  repeating  the  experi* 
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ments  corresponding  to  y  =  1  and  y  =  -1  each  half  the  time  (as  was 
well  known).  Furthermore  the  variance  of  the  estimate  of  ^  should  be 
1/h. 

Elfving's  result  applies  in  the  obvious  fashion  to  experiments  in¬ 
volving  k  parameters.  Here  we  need  repeat  at  most  k  of  the  avail¬ 
able  experiments  in  certain  proportions  to  obtain  the  optimal  estimate. 

4.  RESULTS  FOR  THE  MORE  GENERAL  PROBLEM,  As  mentioned 
in  the  proceeding  section  the  problem  treated  by  Elfving  is  a  special 
case  of  the  more  general  one  formulated  in  section  2,  For  this  more 
general  problem,  related  results  have  been  obtained  [0  «  These  results 
concern  designs  which  are  asymptotically  locally  optimal.  We  shall 
defer  the  interpretation  of  tb*e»  adjectives  until  the  difGUi  sion  of 
Example  2  in  section  5. 

It  was  shown  that. asymptotically  locally  optimal  designs  depsnd  oh 
the  form  of  the  matrix  J(e)  which  is  defined  as  Fisher's  information 
matrix  divided  by  the  cost  of  the  experiment  a,  In  other  words  if 
experiment  e  has  cost  C(e)  and  yiaAds  data  X  with  probability  dis¬ 
tribution  f(x,  Q  ,  e),  Fisher's  information  matrix  is 

I(.)  .  |)E{  a  1o»  •  •'  ^  ■  ■)  )|| 


and  the  information  per  unit  cost  is 

J(e)  *  I(s)/C(e). 


Clearly  if  the  cost  of  experimentation  is  constant  one  need  concern  one¬ 
self  only  with  1(e).  The  relevance  of  Fisher's  Information  derives 


-  I  1  .  .11  I-..  ta  .1  JJ  M.  .. 

AFVIIl  Ail  WOU  AUVVm  •UUAV4  V  W  y*W|»W***B 


•  -  -  J  iUi 


likelihood  estimate 


Uttons  of  e, 


.  aaatweaaeaaasasa  “ 

n  independent  repe- 

has  an  approximately  normal  distribution  with  mean  Q  and 


based  on  the  outcome  of 
n 


covariance  matrix  [ni(e)]  for  large  n 
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When  it  is  desired  to  estimate  one  function  of  the  k  parameter^, 
there  are  asymptotically  locally  optimal  designs  which  involve  at  most 
k  of  the  experiments  of  £  in  certain  proportions.  This  result  which 
corresponds  to  one  of  Elfving's  results,  together  with  the  use  of  Fisher's 
Information,  permits  one  to  reduce  the  calculation  of  optimal  designs  to 
the  maximization  of  a  function  of  a  fixed  number  of  variables. 

In  the  linear  regression  problem  of  Elfving,  the  information  matrix 
for  e  =  (yj,  is 


1  a  II  y^ll  °  J- 


Since  asymptotically  optimal  designs  are  determined  by  the  information 
per  unit  cost  it  follows  that  for  any  problem  where  J(e)  can  be  put  in 
the  above  form,  the  solution  is  the  same  as  Elfving's  with  aj  replaced 
by  _ii. 


be 


i 


The  illustration  of  the  next  section  will  help  clarify  the  meaning  of 
these  results.  In  the  meantime  it  may  be  remarked  that  if  for  each 
experiment  the  distribution  of  the  outcome  depends  on  only  one  function 
of  the  parameters,  J(e)  can  be  put  in  the  above  form  and  Elfving's 
results  are  applicable.  In  particular  they  are  applicable  to  both  examples 
L  and  3. 

5,  ILLUSTRATION.  We  shall  find  it  informative  to  illustrate  the 
method  with  example  2.  Here  the  outcome  of  the  experiment  s  is 
success  or  failure  where  the  probability  of  success  is 


«/  < 
X-  »  - 


rod 

!\'u  I 


V 


"t  /  2  dt  =  1  - 


where  is  the  normal  cdf.  In  other  words  the  role  of  the  density 
f(X,  Q  ,  e)  is  played  by 
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.  X,.  .1~X 

f  =  p  (1  -  p) 


where  X  *  1  for  succes*  and  0  for  failure. 


iog  f ».  x  log  p  *  (1  -X)  log(l  -  p) 


8  log  f 
*V- 


e  t os  i 

8  & 


X  -  p  &p 
pU  -  p)  8 1± 


%  ‘  p  M 
P\  1  -  P)  B(f 


Since  E£(X-p)Z  3»  p{l*p)  , 

J(a)  *  life)  *  [  P<1  -  P>]  Ml 
J{»)  * 


!<&->  ft  ft 


»/« 

Bg  iB. 
a r 


where 

end 


Yj(«)  *  [  PU“P)]  P(1**P)]  ^  <T  exp  | -(•“/*  )^/2r 


y2(s)  «[pU-p>]  "1/Z|S  *[2ffpU-p)"^2  (e-K)^-2  exp  [-(s-fi  )*/Z(y  *) . 


Next  W5  plat  Uie  set  of  [  y »>»  y2i‘sij  m  Figure  i.  we  aad  the 

negatives  of  these  points  end  construct  S  the  imelleet  convex  set  contain¬ 
ing  them.  We  note  that  for  s  a  b  +  t  er  ,  y^ej/y^B)  -  t.  We  also  note 
the  curve  of  [y^a).  y^e)]  reaches  its  maximum  and  minimum  at 
a  =  p  4  k0&*  where  kQ  a  1.  57  .  Filially.  since  we  wish  to  estimate  K  .  k<r, 
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we  draw  the  vector  from  (0,  0)  through  (1,  -k),  i,  e,  the  line  through  the 
origin  with  slope  »k,  and  note  where  it  penetrates  the  convex  set  S. 

Clearly  there  are  two  cases,  V 


VHBb 


1 1.1  v  I. 


nyv 


at  one  of  the  original 


Here  the  vector  penetrates 

(*),  •)  I  points.  In  fact  this  point  corresponds  to  a  a  -k tf  and 

hence  the  optimal  design  consists  of  using  s  a  f*  -kc*  for  all  obserw 


vations, 


Case  2.  |kj>kQ,  Here  the  vector  penetrates  S  at  the  straight  line 

section  of  the  boundary,  The  optimal  design  consists  of  applying  the 
■tress  levels  H>  -kG*  and  p.  in  proportions  k-rkQ  to  k-kQ. 

In  cases  1  and  2  this  formal  application  of  the  formula  for  the  variance 
of  the  maximum  likelihood  estimate  of  p.  -kef  based  on  the  optimal 
design  is  given  by 

2  . 

27Tcr'20(k)[l~$<K)]  ek  n"1 

in  case  1 ,  and  c  .»  •! 

kz 

2TT^2^(ko)  [l-|(k0)]  e  °k“2  kzn"1  -1.64^k2n"1 

in  case  2. 

.  6,  THE  RELEVANCE*  OF  OPTIMAL  DESIGN.  Now  we  shall  find 

the  illustrative  example  helpful  in  interpreting  the  re  suite  of  the  theory 
of  optimal  design  of  experiments  and  in  underatanding  its  relevance  in 
practical  application!.  For  simplicity  let.us  confine  our  attention  to 
case  2  at  first,  ■ 

(Tint  Ufa  nntm  nn*.  vary  panulinr  iiinarf  lit  rij*  optitii2.1  dSSijH,  SinCC 

it  involves  using  stress  levels  -k^  and  p.  +k ;  <r.  ,  to  apply  it  one 

must  know  M-  and  6*  .  But  if  one  knew  and  <Y  ,  there  would  bs  no 

need  to  experiment,  '  While  this  seems  to  be  ridiculous,  a  glance  at 
figure  1  indicates  that  if  one  used  an  approximation  to  p-  +k^r  ,  one 
would  have  a  rather  good  approximation  to  the  optimal  design.  Thus 
there  is  surprisingly  little  ldss  of  efficiency  whan  one  in  not  certain 
about  K  and  O'.  It  is  this  property  that  the  word  local  is  used  to  describe, 

In  ether  words  pur  design  would  be  efficient  if  we  knew  the  parameters  and 


1/ 
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1/ 
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is  approximately  efficient  if  we  us«  «n  approximation  to  the  unknown 
. ,  parameters.  ■  '■*  •. 

'r  This  raises  the  issue  of  the  adjective  asymptotic .  If  one  had  a  large 
sample  available,  one  could  use  seme  of  the  initial  observations  4©  3£r*v« 
an  Initial  estimate  of  and  on  which  to  base  an  approximation  to  the 
optimal  design.  Furthermore  the  qualification  asymptotic  derives  from 
a  couple  of  other  aspects.  First,  ths  properties  relating  the  variance 
,  of  the  approximate  distribution  of  the  maximum  likelihood  to  ths  infor* 
motion  matrix  and  giving  the  efficiency  of  this  estimate  is  based  on 
asymptotic  theory  assuming  large  sample  else,  A  second  and  relatively 
minor  point,  Is  illustrated  by  example  1  if  an  odd  number  of  observations 
are  available,  The  optimal  design  calls  for  putting  half  the  observations 
at  nil  and  half  at  4.  This  is  impossible  in  a  trivial  way  when  n  is  odd. 
On  the  other  hand  ths  effict  of  this  impossibility  is  negligible  when  n  is 
large, 

Having  seen  how  we  must  qualify  the  tern  optimal  by  the  adjectives 
local  and  asymptotic,  we  can  now  consider  s  mors  fundamental  issue, 
Briefly,  our  optimal,  design  is  simply  impractical.  Only  In  the  rather 
unrealistic  context  where  1  had  absolute  faith  in  the  model  would  £  con¬ 
sider  this  as  a  solution,  In  fact,  any  reasonable  statistician  would  insist 
on  using  several  ether  stress  levels  at  least  to  cheek  on  the  model,  ~ 

■■  Another  unreasonable -aspect  of  our  -©pUiaal- design  arise*  from  its  - 
derivation  based  on  the  single  minded  purpose  of  obtaining  ft  good  esti¬ 
mate  of  one  function  i(&  y,  &  2, . . , ,  0^)  of  the  parameters.  In  many 

practical  problems,  experimentation  is  used  to  serve  several  purposes 
simultaneously, 

One  may  reasonably  inquire  about  what  function  does  the  theory  of 
optimal  design  serve,  if  (1)  the  optimality  must  be  qualified  as  locally 
asymptotically  optimal  and  (2)  the  designs  it  yields  trrunroiieftabli^ 
Basically  the  fur.cilw,,*  « ,  ■  th*  following,  First,  the  theory  provide  an 
yardstick  for  comparison  purposp;,  If  ths  designs  proposed  yesterday 
by  Mr.  Lanali*.  or  the  Up  find  flown  Method  ff,  p,  Slf  J,  or  some  Other 
practical  design  turns  out  to  be  relatively  efficient  compared  to  our  solu¬ 
tion  (as  measured  by  asymptotic  variance)  then  clearly  there  is  no  point 
in  attempting  to  Improve  on  this  aspect  of  these  methods,  If,  on  the  other 
hand,  one  of  these  methods  were  to  have  a  low  efficiency,  then  one  is 
forced  to  delve  deeper  to  e-e  what,  if  anything,  car.  be  dons  to  improve 
the  design. 
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Second,  theory  not  only  presents  an  optimal  design  but  indicates 
rather  clearly  how  this  design  can  be  modified  with  relatively  low  lots 
of  efficiency*  The  theory  serves  to  direct  the  attention  of  the  practical 
statistician  toward  designs  which  combine  relatively  high  efficiency  with 
practical  utility  when  robustness  and  multi-purpose  considerations  are 
taken  into  account*1 


7.  MISCELLANEOUS  COMMENTS,  1  would  like  to  conclude  this 
paper  with  a  few  assorted  comment^  ""First,  the  proposed  solution  to 
example  2  in  case  i  when  |l^  £  ka  consists  of  repeating  one  experiment 
n  time*.  Not  only  is  this  eolution  impractical,  bUtfroth  a  theoretical 
point  of  view  it  represents  e 'degenerate  situation*  When  a  single  level 
s  is  used,  one  can  use  the  data  to  estimate  only 


*p(i,  M. ,  CT)  * 


<210*1/20'*  11  dt 


j  ■  ■  if 

or  functions  of  p(s,  ^  ,  a  )•  Then  one  can  check  whether  JLlJL.  is  in 

fact  close  to  k  (as  it  should  be  if  the  design  were  optimal).  But  not 
knowing  d  i  one  can  not  estimate  f*  -k  <f  \  Thus  the  formula  for  the 
asymptotic  variance  presented  at  the  end  of  section  5  is  meaningful 
only  as  an  approximation  to  the  case  where  several  levels  of  stress 
close  to  the  optimal  one  were  used,  Alternatively  oha  couldxri|ard 
pi,l“p)n‘1  as  the  asymptotic  variance  of  the  estimate  of  p. 

For  a  Urge  sample  sequential  procedure,  it  seems  clear  that  our 
theory  is  applicable.  If  one  were  to  reestimate  the  pa ramete rotter 
each  observation}  and  use  these  estimates  to  derive  approximations  to 
the  optimal  design,  the  resulting  procedure  should  be  asymptotically 

optimal  in  the  sequential  versions  and  the  adjective  local  need  not  be  . 

- • 

What  is  more  interesting,  perhaps,  is  the  study  of  the  "not  so  large" 
■ample  sequential  case.  Htsre  even  the  following  seemingly  simple 
problem  proposed  by  Harold  Gumbel  does  not  have  a  simple  solution. 
Suppose  that  experiment  yields  observation  X,  which  is  normally/ 

i  1  2 

distributed  with  unknown,  mean  b  smd-uaknosm-Vfirissc* »nd 

it  is  desired  to  estimate  .  In  other  words,  two  measuring  instruments 
of  unknown  accuracy  are  available.  How  should  one  select  between  the 
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two  experiments  sequentially  so  as  to  obtain  a  good  estimate  effbciently 
when  the  sample  size  is  not  necessarily  very  large? 
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VIBRATION  EXPERIMENTS 
P.  Pradko 

Dynamic  Simulations  Laboratories 
u.  s.  Army  Ordnance  Tank- Automotive  Command 


The  design  of  military  vehicles  is  a  rather  complicated 
mixture  of  many  technical  activities.  In  each  new  development 
of  a  tank,  truck  or  jeep,  a  substantial  amount  of  engineering 
ideas  are  required  to  be  blended  together  to  bring  forward 
vehicles  possessing  features  and  merit  of  advanced  capability. 

While  each  vehicle  development  is  a  separate  and  distinct 
program,  there  are  development  goals  and  problems  that  contin¬ 
ually  reappear  and  appear  to  be  common.  For  example,  it  is 
always  important  to  create  a  good  suspension  system  and  it  is 
squally  important  to  provide  a  dynamically  stable  vehicle. 

The  Suspension  System  is  vital  for  it  detarminaa  the  ve¬ 
hicle  ride  and  vibration  behavior  and  it  ,alao  establishes  the 
tolerable  speed  limit  of  travel  over  various  terrain  surfaces, 
both  for  the  man  and  tha  machine. 

‘  ••  '  •  v.. 


PIG.  1.  STEP  ONE 
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Vehicle  stability  ia  a  design  area  that  also  receives  con¬ 
siderable  attention,  particularly  in  combat  vehicle  progress 
Where  large  caliber  Weapons  are  expected  to  be  fired  front  Chassis 
of  reduced  weight  and  decreased  sice.  Within  Military  circles 
reference  to  vehicle  stability  differs  from  the  usual  automotive 
connotation-  in  place  of  steering  behavior  or  directional  con¬ 
trol,  vehicle  stability  pertains  to  pitch  and  roll  movemant, 
resulting  from  the  gun  recoil  forces. 


FIG.  2.  STEP  TWO 

These  two  elements  of  vehicle  design  can  be  considered 
as  perennials.  They  are  always  around  and  unfortunately  they 
are  rather  "tough  nuts"  to  handle*  individually  they  present 
major  stumbling  blocks  to  design  engineers.  Scrmelly,  useful 
study  of  these  problems  is  beyond  the  level  of  developing  a 
new  layout  or  "cranking"  through  several  equations  on  a  desk  cal¬ 
culator.  As  a  result,  the  magnitude  of  each  task  has  produced 
design  specialists.  2hsss  people,  however,  ere  not  medicine 
men  who  consistently  are  able  to  generate  successful  answers > 
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•*«*¥  need  help;  they  need  either  physical  or  anelytioel  means 
to  guide  end  manure  their  design  approadhee.  Consequently, 
knowledge  of  these  systesis  must  he  consistently  bolstered  and 
expanded.  This  demand  requires  unique  capability; 

First,  since  all  wheeled  and  tracked  vehicles  are 
earth  bound,  knowledge  of  road  prof ilea  or  terrain  contours 
upon  Which  they  move  must  be  secured. 

Seat,  detailed  mathematical  model*  are . naoeesary  that 
dasoribe  the  vohicle  and  how  it  raaats  to  external  diaturbancea 
or  internal  daslgn  changes. 

Then,  an  accurate  recording  procedure  le  essential 
to  transmit  rssults  from  high  speed  computers  in  such  format 
that  their  meaning  may  be  assessed  graphically,  visually  cr 
physically. 

The  benefits  of  integrating  these  steps  would  be  a  com¬ 
plete  capability  for  realistic  design  evaluation  comparable 
to  controlled  tests  at  a  proving  ground. 

Accordingly,  the  Army  Tank- Automotive  Command  sought 
s  means  to  physically  simulate  the  suspension  performance  and 
stability  dynamics  of  a  design  While  it  w*s  still  in  the  blue* 
print  stage,  and  to  bring  together  the  theory,  nathsmetiea  and 
computer  machinery  to  study  each  of  these  problems  indoors  in 
the  laboratory,  it  was  also  the  feeling  that  if  this  program 
was  to  be  successful f  it  must  produce  ilia  ability  to  predict 
behavior  and  allow  practicing  anginaara  the  opportunity  to  pre¬ 
test  their  designs  before  commitment  to  fabricate  expensive 
wood  mock-ups#  experimental  test  rigs  or  engineering  prototypes. 

Stiflaanalaa-SiB^s^ign  > 

Simulation  of  vehicle  suspension  ays terns  is  basically  the 
task  of  predicting  the  motion  response  of  ths  vehicle  i*  distur¬ 
bances  from  the  road.  A  thorough  understanding  of  the  elements 
that  constitute  thie  system  and  their  interrelationship  is 
essential  to  such  study.  Beginning  with  ths  road  is  perhaps 
logically  th«  first  step,  sSsa  basic  segeirsment  is  to  present 
to  the  Wheels ,  springs,  and  snook  absorbers,  the  vertical  dis» 
placement  and  frequency  identical  to  those  existing  in  road 
os  terrain  surfaces.  For  this  purpose  it  is  possible  to  construct 
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a  computer  nodal  of  a  road  profile  using  either  digital  or  ana- 
log  computer  techniques.  Tha  basic  data  profile  information  may 
be  secured  by  conventional  rod  and  transit  means  or  automatic 
measuring  instruments. 

in  real  life  tha  road  is  a  stationary  wave  form  aver  Which 
the  vehicle/  travels.  The  relationship  between  oar  veloaity  and 
the  static  road  generates  the  suspension  dynamics. 

In  a  computer  simulation  the  vehicle's  forward  movement 
aan not  be  faithfully  reproduced.  To  conveniently  maintain  an 
order  of  reality  the  road  ia  moved  instead.  The  road  prof ile 
is  presented  to  the  suspension  components ,  as  a  continuous  raav»> 
ward  valooity  that  normally  would  be  road  speed. 

To  aoaurately  duplicate  the  physical  caae  tha  road  le 
presented  to  each  wheel  separately,  properly  phased  so  that 
tha  rear  wheels  Meaa*  the  same  road  irregularities  as  the 
front  wheels,  although  at  a  later  time.  This  phasing  is  gov¬ 
erned  by  the  wheel  base  and  vshiale  speed. 

One  successful  prooedurs  of  road  profile  generation  uti¬ 
lises  a  digital  powputar  and  a  digltal-to-analog  converter. 

The  digital  machine  stores  the  road  profile  data  in  elevation 
increments.  It  selects  the  elevation  that  each  Wheal  requires 
at  a  particular  time  and  generates  the  time  between  elevations. 

Several  preliminary  considerations  which  must  be  resolved 
before  the  construction  of  such  a  digital  road  function  include i 

1.  The  number  of  vehicle  wheels. 

8 »  The  spaaing  between  wheele* 

Si  Th«  Mfcarting  road  level. 

4*  The  number  of  computer  cells  per  road  inarement. 

5.  overall  length  of  the  road  profile. 

| 

The  time  at  which  a  particular  point  on  the  road  will 
arrive  *t  each  wheel  is  determined  by  the  wheel  spacing.  This 
spacing  ia  also  considered  in  deciding  how  many  elevation  values 
will  he  equivalent  to  one  linear  foot  of  road.  The  following 
example  will  illustrate  these  points. 
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A  vehicle  suspension  is  set  up  on  the  analog  computer# 
this  simulation  is  foe  one  side  of  the  vehicle  only*  it  being 
assumed  that  the  other  side  is  identical.  The  vehicle  has  four 
wheels  on  a  side,  spaced  two  feet  apart.  It  will  be  driven  over 
a  Belgian  Block  type  road.  The  road  consists  of  30?  elevations 
spaced  one  foot  apart.  These  things  being  known,  it  is  pos¬ 
sible  to  prepare  e  scheme  for  generating  the  road  function  which 
will  peas  under  each  wheel  in  sequence.  To  rerun  the  road  after 
onoe  traversing  it,  a  starting  road  level  must  be  assumed,  us¬ 
ually  the  initial  starting  elevation,  or  vary  near  to  it.  For 
tha  conditions  just  outlined  e  situation  similar  to  that  shown 
in  Pleura  3  will  exist. 


Preliminary  assumptions: 


1.  Vehicle  Is  sitting  on  road  level, 
a.  Start  o f  road  atrtkea  1st  wheel 
3.  One  computer  word  -  1  linear  ft. 


END 
OF  RUN 


s 
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WHEEL  #1 

WHEEL  #2 
WHEEL  #3 
WHEEL  «4 


RESUME 


FIG.  3.  ROAD  PROFILE 

Hie  beet  procedure  in  this  instance  la  to  let  one  foot  of 
road  be  represented  by  one  computer  word.  However,  if  the 
spacing  between  wheels  is  uneven,  a  scheme  utilising  several 
words  to  the  linear  foot  would  be  required. 

After  the  preliminary  road  function  details  have  been  ac¬ 
counted  for,  the  actual  generation  of  the  road  function  can 
be  undertaken.  This  naturally  divides  into  the  following 
steps i 

1.  Preparation  of  the  data  tape. 

2.  Placing  road  level  data  into  computer  memory. 

3.  Generation  of  the  road  function  tlkpe. 

4.  Transfer  of  the  road  function  data  to  the  dig ital¬ 
ic-  analog  converter,  etc. 


Bach  computer  "word"  of  information  contains  five  channels 


four  of  which  are  used  for  terrain  simulation.  Each  of  these 
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channels  may  represent  data.  An  algebraic  representation  of 
such  a  word  is  1  aa  bb  cc  dd  00,  where  each  pair  of  letters 
represents  one  Channel  in  the  output  of  the  Digital-Analog 
conversion  system,  while  the  number  (l)  in  the  sign  position 
designates  a  particular  group  of  D-A  Converters,  (Note  that 
since  the  last  Channel  is  not  used  it  is  represented  by  00, 
i.e.  no  information  present) .  "With  proper  scaling  and  pro¬ 
gramming,  each  channel  a  an  be  coins  a  road-prof  lie-wheel- 
terrain-functicn-generator  (rfwtfg).  Henaa,  there  are  four 
RPWTFa's  per  ocsnptiter  word. 


I- 

S' 


The  time  between  data  inoraaents  on  the  ocmputer  ia 
generated  by  using  a  time  control  subroutine  which  increases 
or  deoreaees  the  time  between  “calling  up"  the  data  inoramente. 
•The  speed  of  the  read  function  is  determined  from  the  recorder 
tracings  aa  fellows* 


mph  =  iflfluAJLMgflLJBfc  EffWi  UtJ 

length  of  convsrtad  road  (mm) 


x  paper  spaed  *  J&fi. 


44  ft/eeo 


By  this  proosdure  vshicls  road  apaad  Is  eetMbliehed.  Maximum 
road  spead  is  only  limited  by  the  computers  ability  to  call 
up  data,  utilisation  of  a  tins  delay  subroutine  within  the 
computer  facilitates  decreasing  the  speed.  Also,  greater  speed 
can  be  attained  by  shortening  the  road,  i.e.  picking  up  every 
second  or  avery  third  road  slevation.  Oscillograph  record¬ 
ings,  es  generated  by  this  system,  axe  illustrated  in  Figure  4, 


mum  tien 


FIG.  4.  ROAD  PROFILE 
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A  magnetic  tape  recorder  and  reproducer  add  convenience 
and  efficiency  to  the  system*  By  recording  successive  speeds 
on  magnetic  tape i  the  digital  computer  is  used  only  once  for 
a  particular  vehicle,  in  addition,  veloaity  multiplication  may 
be  obtained  by  recording  at  one  speed  and  reproducing  at  higher 
speeds. 

Thus,  any  terrain  that  can  be  numerically  described  ae 
increments  of  elevation  with  respect  to  horizontal  distance, 
can  be  simulated  with  a  digital  computer  for  the  analysis  of 
vehicle  behavior. 

With  the  road  prepared  the  simulation  requires  a  medal 
of  the  suspension  system.  For  this  purpose  the  Analog  aoeaputer 
is  bast  suited.  The  computer,  aa  used,  provides  an  accurate 
representation  of  the  design,  in  a  true  sense  the  computer 
is  an  alaatronio  model  of  the  vehicle.  The  degree  of  realism 
achieved  is  naturally  governed  by  the  quantity  of  vehicle 
characteristics  simulated. 

As  in  any  simulation,  the  system  is  first  described  by 
e  mathematical  model.  Wie  equations  represent  the  dynamic 
system the  Vehicle  Chaeaie,  the  auapsneion  system  and  the 
road  eurfaca  input. 

Vehicular  vibration  components  include  the  mass  and  iner¬ 
tia  of  the  sprung  components,  the  auepeneion  springe,  abode 
absorbers,  road  wheel  masses,  and  the  spring  And  damping 
Characteristics  of  the  whsel  assembly. 

The  typical  method  of  describing  a  vehicle  to  be  simu¬ 
lated  is  shewn  in  Figure  'A  and  Figure  6.  From  the  diagrams, 
the  aquations  of  motion  may  be  stated,  'Sheas  expressions 
are  written  as  common  linear  differential  equations  with 
non-linear  coefficients. 
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FIG.  5.  VEHICLE  CONFIGURATION 

Non-linaaritlas  in  th«  simulation  axist  normally  du« 
to  non- linear  spring  Oharactariatioa,  doubla  acting  shook 
abaorbara,  and  tha  fact  that  vfhsala  may  laava  ths  road  aur- 
faca. 


FIG.  6.  VEHICLE  SCHEMATIC 
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The  equations  result  from  linear  and  angular  counterparts 
of  Newton's  second  law  of  motion.  The  summation  of  the  vertical 
forces  on  the  chassis  equals  the  mass  of  the  chassis  times  its 
vertical  acceleration;  the  summation  of  the  torques  about  the 
center  of  gravity  is  equal  to  the  polar  moment  of  inertia  times 
the  angular  acceleration  of  the  hull.  The  forces  and  torques 
result  from  relative  displacement  and  velocity  of  the  springs 
and  shook  absorbers  respectively.  For  example,  the  vertical 
forca  of  the  front  wheal  spring  is  equal  to  the  spring  constant 
(K£>  times  the  relative  displacement  between  the  wheel  and  the 
chassis  just  above  the  Wheel.  Similarly,  the  torque  is  a  pro¬ 
duct  of  this  force  times  the  distance  from  the  center  of  grav¬ 
ity*  The  shock  absorber  force  ia  a  product  of  the  damping 
coefficient  and  the  relative  veloaity  between  the  wheel  and 
the  ahassia  above  the  wheel. 

Chassis,  pitch  and  bounce  equations  may  be  developed  using 
thass  relationships.  Separate  differential  aquations  ara  written 
to  dasariba  the  motion  of  each  wheel.  Auxiliary  equations  ate 
written  to  ralate  the  pitch  motion  to  the  vertical,  motion  so 
that  the  displacement  and  velocity  of  the  Chassis  at  each  wheel 
station  may  be  found. 

Each  wheal  of  the  vehicle  is  considered  a  separata  mass, 
spring,  and  damper  system  connected  to  the  ground  and  to  the 
chassis,  the  link  to  the  chassis  being  the  suspension  spring 
end  shock  absorber.  The  force  smarted  on  the  wheel  by  the 
ground  is  equal  to  a  product  of  the  wheel  rubber  displacement 
and  spring  constant.  This  force  may  have  only  one  sign  since 
the  ground  aannot  "pull"  down  on  the  wheel.  The  suspension 
spring  forca  is  also  exerted  on  the  wheal. 
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aa  is  shown  in  rigure*  7  and  6* 
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FIG.  7.  SPRING  LOAD  VS  WHEEL  DEFLECTION 


The  non-linear  suspension  springing  ia  composed  of  taro 
linear  segments,  the  one  of  leaser  slope  being  the  suspension 
spring,  and  the  other  the  bump  atop.  The  shook  absorber  non¬ 
linearity  ia  shown  in  Fig.  8,  which  has  four  linear  segments 
simulating  different  rates  in  compression  and  expansion  with 
blow-off  valves.  Hie  circuitry  for  creating  the  significant 
segments  of  a  suspension  simulation  are  Bhown  in  Figures  9  - 
13,  If  a  wheel  leaves  the  ground,  no  spring  force  can  exist 
between  the  ground  and  the  wheel*  To  provide  for  taxi  rsa*— 
istic  action,  a  diode  representing  a  unidirectional  spring 
force  is  put  in  series  with  the  wheel  feedback  loop,  ae  is 
shown  in  the  wheel  circuit.  Figure  11* 
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Simulation  begins  when  the  electronic  version  of  a  road 
and  suspension  system  are  brought  together.  Results  are  best 
analyzed  using  oscillographic  or  pen  recorder  output  devices* 
Recorded  paper  tracings  provide  an  excellent  permanent  record 
for  lengthy  detailed  analysis.  The  oscillograph  display  system 
offers  an  opportunity  to  observe  the  simulation  visually  as  an 
animated  presentation.  The  dynamics  of  a  complete  vehicle  or 
any  component  thereof  may  then  be  studied.  This  display  system 
is  used  in  conjunction  with  the  analog  computer.  A  cathode-ray- 
tub  a  is  used  to  convert  the  output  voltages  of  the  computer 
into  a  diract  pictorial  representation.  Application  of  this 
system  is  shown  in  Figure  14.  The  series  of  photographs  de¬ 
scribe  the  motion  of  a  tank  that  would  be  aaan  on  the  tube. 

The  vehicle  is  shewn  negotiating  at  successive  instances  a 
4"  x  4"  square  obstacle. 


FIG.  14,  VISUAL  DISPLAY  SYSTEM 


This  visual  display  provides  a  quick  and  easy  method  of 
conducting  a  preliminary  analysis  of  new  suspensions.  It 
is  also  *  good  means  of  debugging  a  new  simulation  setup* 
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Results  of  ccaeputer  simulations  may  also  b«  studied  with 
the  aid  of  a  motion  simulator.  The  value  of  the  Simulator* 
Figure  15*  lies  in  its  ability  to  physically  reproduce  realis¬ 
tic  "ride  motion"  that  may  be  predicted  by  a  computer  simulation 
Thus,  by  combining  computer  studies  of  new  concepts  with  a  sim¬ 
ulator  analysis,  design  merits  may  be  judged  in  the  laboratory 
by  engineers ,  designers*  and  adminiatrative  people  before  a 
design  is  considsred  for  fabrication*  Each  individual  may  ride 
a  new  suspension  in  the  Simulator  and  personally  evaluate  his 
area  of  interest  firsthand* 

The  simulator  described  below  is  a  four  degree  of  freedoai 
machine  capable  of  providing  bounce*  pitch*  roll  end  yaw  mo¬ 
tions. 


■il 


FIG.  15.  SIMULATOR 


The  control  of  the  machine  is  optional*  The  Simulator 
may  be  controlled  from  an  instrument  panel  to  produce  either 
sine*  square  or  triangular  motions.  Random  motion  inputs  may 
be  fed  directly  into  the  Simulator  tram  an  Analog  computer 
simulation  or  by  reproducing  information  previously  recorded 
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This  machine  is  hydraulically  driven  and  electronically 
controlled.  Each  of  the  four  motions  may  be  used  individually 
or  simultaneously.  I 

Motion  3aml  jflB&i-XES&ffllfly  Acceleration 


Bounce  3  ft 
Roll  40  dog 
Pitch  40  deg 
Yaw  20  deg 


10  cpa  2  g*a 

10  ops  20  radiane/sec3 

10  ops  30  radiane/sec3 

3  cpa  13  radians/sac2 


Perhaps  the  most  significant  claim  that  can  ha  broadcast 
for  ths  Simulator#  at  this  time#  is  that  it  will  maka  possible 
performance  trials  of  designs  prior  to  building  of  a  design, 
in  soma  instances  it  is  the  only  economical  approach#  consider¬ 
ing  time  and  aoat#  particularly#  where  a  new  deaign  is  being 
investigated  using  many  alternatives. 

Ohs  araation  of  this  Simulator  provides  the  Army  Tank- 
Automotive  Command  with  a  design  tool  that  has  bean  sought 
for  soma  time.  The  need  for  an  instrument  of  this  kind  has 
bean  in  continuous  demand  for  military  auapanaion  studios  and 
other  shock  and  vibration  programs. 


FIG.  16.  DYNAMIC  SIMULATION 
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The  immediate  response  to  the  Simulator  was  generally 
favorable,  but  reserved.  Comments  usually  indicated  that  the 
vibratory  motions  were  good.  However,  it  was  repeatedly 
stated  that  the  laboratory  environment  around  the  Simulator 
degraded  the  intended  realiam.  The  common  complaint  was  that 
the  "out  Of  doors”  atmosphere  seemed  to  be  missing. 

To  compensate  for  this  a  visual  display  was  areated  pro¬ 
viding  a  180  degree  field  of  view  horisontally  and  48  degrees 
in  the  vertical  plana.  A  35mm  motion  piatura  format  was  used 
to  produce  a  "three  screen"  presentation.  This  method  was 
selected,  based  upon  successful  tryouts  of  a  unique  projection 
system  developed  and  tailor ad  to  the  Simulator. 


CMtIM  i 


FIG.  17.  CAMERA  SYSTEM 
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FIQ,  18.  PROJECTION  SYSTEM 

fli*  activity  scene  Is  photographed  by  three  oeneree 
and  faaokprojeatad  to  the  subject  In  the  simulator  by  three 
a ynohroniaed-inter looked  projector a.  3hia  system  preaenta 
to  the  obaarvar  a  scene  that  oooparea  favorably  to  a  view 
from  within  a  moving  vehicle. 


rid,  19.  DISPLAY  SYSTEM 
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lb*  simulator  was  also  used  to  simulate  vehicle  firing 
stability  dynamics.  The  starting  ous  for  this  program  was. 
vary  forceably  observed  in  vehicles  lilt«  ths  Self-Propelled 
Artillary  Weapon  shown  in  Figure  20. 


rifl,  20.  SELF-PROPELLED  ARTILLERY  WEAPON 


In  keeping  with  this  indicated  trend  of  big  guns  on 

Sm.l  wua.ii.  plsMuiSa  it  wmm  11  wnMig  to  ■lisbliffh  with 

graatar  accuracy,  the  stability  of  contaaplatad  designs. 

The  characteristic  evanta  describing  fire  stability  wars 
analysed  by  Charting  the  flow  of  events  and  establishing  the 
agnations  of  motion. 


na.  21.  VUHJCLB  BdHMATlC 


VitMfll  MUNB  STAOiUTV  klM>  fiUAHAM 


fTfl=  22?  FlOW  DIAGRAM 
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LONGITUDINAL  .TRANSLATION!  GUN  FORCE  4  GROUND  FRICTIONAL 
FORCE  -  MASS  X  ACCELERATION  Fgx  +  »£*  “  m  (x-y  4*  4  zQy) 

LATERAL  TRANSLATION >  GUN  FORCE  4  GROUND  FRICTIONAL  FORCE  « 
MASS  X  ACCELERATION  Fgy  4  Ffy  -  at  (y-*«x  4  x«z) 

BOUNCE!  GUN  FORCE  -  SPRUNG  WEIGHT  4  SUSPENSION  FORCES  ■ 
MASS  X  ACCELERATION  Fge  -  W *0*55  4  nj-  »£  •  M  <2-x4y  4  ydx) 

1*1 


ROLLi  GUN  MOMENT  4  GROUND  FRICTIONAL  MOMENT  4  SUSFENSIONAL 
MOMENT  m  ANGULAR  ACCELERATION  X  MOMENT  OF  INERTIA  -EFgy  4 
y*g«  +  (*  +  to)  FfyCyY  4  ny  NiYi  -  <JxXx  -  4zXxa  4 

IT"  1 

(Ijj  -  ly)  Oyd*  -  IX*dxdy 

PITCH t  GUN  MOMENT  -  GROUND  FRICTIONAL  MOMENT  -  SUSPBNS TONAL 
MOMENT  -  ANGULAR  ACCELERATION  X  MOMENT  OF  INERTIA  -  Sfgg  4 
**gx  -  <*  +  «0)  Ffx«xx  -  *V  »i*i  *  Oyly  +  «x«x  dx  -  I§> 

i  -  1 

4  (dx  -  djj)  Ix*  ■ 

YAW  i  GUN  MOMENT  4  GROUND  FRICTIONAL  MOMENTS  *  ANGULAR 
ACCELERATION  X  MOMENT  OF  INERTIA  -?FgX  4  Sf gy  4  *V 

Xi*fiy  oyy  -  V  yiFfix«xX  -  «SX.  -  S*Ix*  4 
i  -  1 

(ly  -  lx)  dxdy  4  IXBdydB 

«!•  derived  statements  ware  for  weapon  systems  free  to 
move  in  three  degree*  of  angular  freedom  -  roll,  pitch  and 
yawf  and  three  degrees  of  translational  freedom  -  fore  and 

■  #*>  NLAifMNmnPi ^  tj^£pv  uRiik  htM ■  4^4 nMni  ’ jii'A 

vehicle  motion  an  effected  by  interrelated  factors  of  gun 
firing  force.  gravity,  terrain  influence,  and  the  reaiating 
forces  of  the  suspension* 

The  dynamics  of  firing  stability  are  calculated  on  a 
digital  computer.  When  this  program  is  used  in  conjunction 
with  the  sisvslf.to?;  the  results  ere  stored  in  computer  memory  a 
The  physical  arrangement  of  the  simulator  permits  the  occupant 
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to  fire  any  weapon  by  merely  pulling  the  usual  tricar.  She 
cofiti&aiid  to  tire  la  complataly  controlled  by  tfca  man  in  th«  teat* 


FIG,  23.  FIRUKJ  SIMUIATION 
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The  inputs  to  this  problem  consist  of  various  vehicle 
measurements#  weights,  moments  of  inertia,  gun  recoil  force, 
type  of  soil,  and  type  of  suspension  (active  or  lodked-out). 
The  output  consists  of  detailed  information  in  tabular  or 
graph  form  showing  angular  and  translational  disturbance*  and 
their  respective  displacements,  velocities, and  accelerations 
with  respect  to  time.  This  information  describing  gun  firing 
force  impact  on  the  vehicle  and  resultant  vibrations  is 
available  for  tha  c.o.  of  the  vehicle  with  reference  to  earth- 
fixed  axes  and  for  any  other  point  on  or  within  the  vehicle, 
sudh  as  gun  mussle,  engine  mounts  and  arsw  stations  with  ref¬ 
erence  to  the  vehicle  axes. 

Summary  i  •’ 

-  \ 

The  combination  or  computers  and  simulation  techniques 
at  the  Army  Tank-Automotive  Commend  has  provided  an  effective 
and  versatile  designer* e  tool,  informative  preliminary  stud¬ 
ies  hava  bean  conduotsd  of  new  suspension  systems  and  stabil¬ 
ity  Charaataristics,  without  the  use  of  hardware  units  of 
the  design.  Probes  of  unique  approaches  hsVe  quickly  estab¬ 
lished  design  direction  and  payoff  areas. 
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SUSPENSION  NOMENCLATURE 

om 

«  Vertical  acceleration  of  the  center  of  gravity* 

• 

Y0  *  Vertical  velocity  of  C.G. 

Ye  =  Vertical  displacement  of  C.G. 

0o  ■  Pitch  acceleration  about  C.G, 

4©  *  Pitch  velocity  about  C.G. 

G0  =  Pitch  displacement  at  C.G. 

(Yj,  ~  Ywi)  -  Relative  displacement  between  hull  and 
wheel  at  Wheel  1. 

(Yj  -  Yvi)  -  Relative  velocity  of  the  hull  and  Wheel 
at  wheel  1, 

(Y^i  -  aj_)  -  Relative  dieplacaraent  between  wheel  end 
input  bump  at  wheel  1. 

■■  '  '  •  '  '  ,  ' 

JX  “  Pitch  Moment  of  Inertia. 

y  ■ 

Mg  m  sprung  masa. 

M w  «  Wheel  mass* 

I  -  Distance  from  wheal  centerline  to  C.G. 
k1-4  "  Suspension  spring  constant. 

I>l-4  “  Shook  absorber  damping  constant. 

=»  Spring  constant  of  road  wheel  rubber. 

D^  =>  Damping  constant  of  road  Wheel  rubber. 

*1-4  “  Road  inputs  to  wheel  No.  1-4. 

Yl_4  “  Chassis  displacement, 
g  *  Acceleration  of  gravity. 


345 


Design  of  Experiments 


VEHICLE  STABILITY  NOMENCLATURE 

Fg  »  Cun  force. 

Fx  «  Frictional  force* 

WE  -  Sprung  weight* 

M  ■  Sprung  mass. 

8,  y,  I  ■  position  of  trunnion  centerline* 
*0  -  Static  height  of  C.G. 
n  *  Number  of  Wheels, 
y,  y,  V  ">  Translational  acceleration. 

9X  Vy  9E  ■  Angular  acceleration, 
y  x  i  -  Translational  velocity. 

9X  4y  6E  ■  Angular  velocity* 

I  -  Moment  of  inertia. 

K  -  Suspension  spring  aonstant. 

D  ■  Shock  absorber  damping, 
a  -  Gun  asimuth. 
e  b  Gun  elevation. 
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SIZE  EFFECTS  IN  THE  MEASUREMENT 
OF  SOIE  STRENGTH  PARAMETERS 

Ben  Hanamoto 

Land  Locomotion  Laboratory 
Army  Tank  and  Automotive  Center 

and 

Emil  H,  Jebe 

institute  of  Science  and  Technology 
The  University  of  Michigan 

INTRODUCTION.  The  main  concern  of  the  land  Locomotion  Lab¬ 
oratory.  ATAC,  is  the  relationship  of  a  vehicle  to  the  terrain  over  which 
it  travels,  Once  an  insight  into  this  relationship  has  been  attained,  the 
problems  encountered  from  the  initial  design  of  a  vehicle  to  its  ultimate 
use  in  the  field  can  be  more  easily  grasped  and  rationally  solved.  The 
solution  of  engineering  problems  depends  upon  the  selection  of  the 
relevant  variables  and  a  description  of  the  functional  relationship  among 
these  variables.  The  selection  of  the  vehicle  variablee  are  within  broad 
limits  at  the  disposal  of  the  designer,  but  for  the  terrain  or  aoil,  the 
selection  of  suitable  variables  becomes  much  more  complicated.  Soil 
is  probably  one  of  the  most  complex  of  all  engineering  materials  [l]  , 
Researchers  in  soil  mechanics  have  added  milch  to  the  knowledge  oi  the 
mechanical  and  physical  characteristics  of  soils,  but  as  yet,  no  fully 
satisfactory  general  theory  is  available. 

Land  locomotion  is  an  engineering  application  of  soil  mechanics  to 
off-road  vehicular  operation.  Its  objective  is  to  determine  the  relation¬ 
ships  of  vehicles,  or  more  precisely,  of  the  wheel  and  track,  to  the 
strength  properties  of  the  soil,  In  land  locomotion  research,  one  of  the 
important  questions  is  the  nature  of  the  pres  sure -sinkage  relationship. 
The  Bekker  equation 


represents  a  family  of  curves  with  three  unknown  constants,  kc,  k-1 , 

and  n,  and  two  variables,  p  the  pressure  under  a  loaded  area,  ana  z 
the  sinkage*  j^j  . 

'*  b  is  a  known  constant,  the  plate  width.  p  is  per  unit  area  {i.  e.  , 
square  inch). 
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A  set  of  these  constants  which  will  approximately  describe  pressure- 
sinkage  observations  can  be  obtained  •  To  determine  these  constants, 
pressure- sinkage  experiments  were  performed  in  the  laboratory  with 
footings  of  various  sizes  and  shapes.  The  constants  obtained  were  used 
to  predict  the  sinkages  for  other  loaded  areas,  It  was  found  that  the  pre¬ 
dictions  were  adequate  for  tracked  vehicles,  where  the  relative  shapes 
of  the  loaded  areas  were  similar.  Rectangular  test  footings  with  a 
length/width  ratio  greater  than  5  were  used  for  determining  the  soil 
parameters  used  in  the  prediction  equations,  The  basic  equation  in¬ 
cludes  only  the  width  term  b,  For  cohesionless  soils,  the  ultimate  . ' 
bearing  strength  is  dependent  on  the  width  only  for  long  loaded  areas  i4j. 
To  determine  what  the  miniriium  length  had  to  be  before  a  footing  was 
not  considered  long,  laboratory  tests  were  conducted  with  footings  of 
varying  -li b  ratios.  Acceptable  results  for  the  pressure -sinkage 
relationship  were  obtained  when  the  (,/b  ratio  was  greater  than  5, 
Consequently,  all  pres  sure -sinkage  measurements  were  taken  with 
footings  of  at  least  an  -L/b  ratio  of  5  or  greater. 

The  ultimate  equations  in  which  these  soil  strength  parameters  are 
to  be  used  apply  to  the  general  case  of  predicting  vehicls  performance 
for  both  tracked  and  wheeled  vehicles.  As  noted  above,  the  predictions 
of  tracked  vehicle  sinkage  and  motion  resistance  have  been  generally 
satisfactory.  For  wheeled  vehicles,  however,  improvements  are  v 
needed.  One  of  the  differences  to  be  noted  between  a  tracked  and  wheeled 
vehicle  is  the  shape  of  the  loaded  area,  In  most  cases,  tracked  vehicles 
have  a  contact  area  of  relatively  long  length  as  compared  to  width. 

Such  a  length-width  ratio  is  not  the  usual  situation  for  wheeled  vehicles 
at  moderate  sinkages.  Most  tires  will  have  a  contact  area  where  the  f  /b 
ratio  is  close  to  1  or  2,  *  Therefore,  it  was  thought  that  the  shape 
of  the  loaded  area  when  X/b  was  less  than  5  might  have  effects  on 
the  pre ssure -sinkage  relationship,  A  clearer  understanding  of  the 
pressure-sinkage  relationship  in  this  region  would  provide  us  with  an 
improved  soil-vehicle  model  with  broader  and  more  useful  applications. 
Consequently,  a  test  program  was  undertaken  by  the  Land  Locomotion 
Laboratory  to  investigate  further  the  pressure-sinkage  relation. 

vEor  example,  the  Army  6  x  6  5-ton  truck  normally  carries  an 
11.00  x  20  tire.  Atone  inch  sinkage,  $  l  b  -  1  and  at  eight  inch 
sinkage  Xl b  =  2.  33. 
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DESCRIPTION  OF  TEST  PROGRAM.  The  test  program  to  study 
the  effect  of  plate  size  on  the  vertical  soil  strength  or  sinkage  para¬ 
meters  was  divided  into  two  parts.  The  first  part  comprised  a  study 
of  the  reliability  or  repeatability  of  the  test  results  for  the  equipment  and 
mixing  techniques  that  were  to  be  used  in  the  tests.  The  second  part 
covered  the  measurement  of  the  load-  sinkage  curves  while  using  differ¬ 
ent  sized  plates. 

In  carrying  out  the  experiments  a  laboratory  model  bevameter  Is 
used  to  drive  a  constant  speed  hydraulic  piston  arrangement  which  pushes 
a  plate  into  the  soil  In  a  bin.  The  depth  of  sinkage  and  the  force  on  a 
load  cell  ate  plotted  electrically  by  an  X-Y  plotting  device.  The 
curve  is  traced  on  linear  graph  paper.  From  this  graph  values  for  p 
and  z  may  be  read  off  and  plotted  on  log -log  paper.  The  slope  of  the 
least  square  fitted  line  on  the  double-log  plot  gives  an  estimate  of  the 
parameter  n.  The  constant  term  in  such  a  fitted  equation  is  the  logarithm 
of 


ii 

i  " 

where  b  is  the  width  of  the  plate  used.  Thus  It  is  seen  that  kc  and 

cannot  be  estimated  by  any  straight  forward  statistical  technique,  Use  of 
two  different  b  values  ,  however,  will  permit  sotting  up  two  simultaneous 
equations  in  kc  and  . 

PART  I,  We  wished  to  determine  the  maximum  number  of  pene¬ 
trations  that  could  be  made  with  one  preparation  of  the  soil  bin.  For 
this  purpose  we  set  up  a  uniformity  trial  using  only  a  2”  x  10"  plate, 
Orientation  and  location  of  the  penetrations  was  arranged  as  indicated 
in  Figure  1.  The  three  orientations  shown  were  carried  out  in  a  ran- 
.domized  block  design  with  six  replicates. 
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4.  5' 


•  15' 


FIGURE  Is  SAMPLE  BLOCK  LAYOUT  FOR  UNIFORMITY  TRIALS 

RESULTS  FOR  PART  I:  M'lean  pressures  were  computed  for  the 
orientations  at  1",  2"  and  3"  depths  of  sinkage.  Mean  differences  for 
the  orientations  at  a  given  depth  were  found  to  be  homogeneous  (i.  e.  , 
not  significant).  At  the  2"  depth  of  sinkage,  the  coefficient  of  vari¬ 
ation  was  about  6  percent,  quite  a  satisfactory  value.  Examination 
of  the  variability  within  the  orientations  showed  that  the  variation  within 
the  arrangement  Aj  was  significantly  greater  than  that  for  the  other 
arrangements. 

CONCLUSIONS  FOR  PART  I:  The  experimental  procedure  would 
yield  results  of  adequate  reliability,  The  orientation  A]  appeared  un¬ 
desirable  for  taking  presaure-ninkage  measurements,  Therefore,  we 
decided  to  make  the  spacings  between  determinations  an  similar  to  the  A 
arrangement  as  practicable.  Since  a  rectangular  plate  of  size  3"  x  10"  2 
was  to  be  used  in  Part  2,  it  appeared  necessary  to  "beef  up  the  apparatus' 
to  handle  the  greater  pressures  required  to  sink  such  a  large  plate. 


PART  2,.  The  second  phase  of  the  test  program  comprised  measure¬ 
ment  of  the  load- sinkage  relation  in  dry  sand  with  plates  of  varying  sizes. 
Analysis  of  test  data  would  provide  estimates  of  the  three  parameters  in 
the  Bekker  equation  and  their  variations  for  the  sizes  and  shapes  of 
plates  used.  The  results  should  show  the  dependence,  if  any,  of  the 
parameters  on  the  size  and  shape  of  plate. 

Many  problems  arose  in  the  consideration  of  the  second  part  of  the 
test  program.  One  point  was  that  all  plates  should  be  tried  in  one  mix 
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A  second  point  is  that  the  sinkage  equation  is  a  stress-strain 
relationship.  It  may  alsd  be  described  as  a  functional  relation  Csj  . 

The  problems  of  estimation  which  arise  for  the  functional  relation  have 
been  resolved  by  Dr,  Joseph  Berkson  by  introducing  the  "control  vari¬ 
able"  concept  £6]  .  It  appears  that  z  may  be  taken  as  the  control  vari¬ 
able  in  our  problem.  This  approach  is  contrary  to  the  usual  dependent- 
independent  variable  point  of  view,  but  Berkson  has  shown  that  the  method 
is  unbiased  for  estimating  the  functional  relation  if  the  errors  in  p  are 
unbiased, 


Thirdly,  it  was  clear  that  a  statistical  analysis  of  the  estimation  pro¬ 
cedure  for  the  Bekker  equation  was  needed.  With  transformation  to  loga¬ 
rithms  of  p  and  z  it  is  assumed  that  the  standard  linear  regression 
assumptions  are  valid  in  the  traiieform  [  .  Thus,  asttmaHon  of  the 

parameter  n  is  quite  straightforward.  When  n  has  been  obtained, 
the  procedure  takes  z  a  I,  hence,  log  z  ■  0,  and  predict*  a  value  of 
log  p,  say  P0<  Now,  anti -log  PQ  a  p*  ■  kQ  +  kc/b.  By  taking  two 
values  of  the  plate  width,  bj  and  b2,  and  corresponding  p^*  and  p2* 
values,  the  estimation  equations  for  kc  and  k  u.  become 


<Pj*  -  P2*)h1b2 


and 

(3) 


b2P2*  •  bi  Pi* 


These  results  pointejd  out  two  things: 

1.  Widely  spaced  b  values  to  permit  use  of  large  b^-bj  would 
reduce  the  variance  of  the  estimates  of  kc  and  k ^  , 

2.  A  formula  for  the  variance  of  p#  is  needed. 

The  variance  formula  for  p#  presents  some  difficulty  because  p*  is 
a  nonlinear  function  of  Fn.  We  recall,  however,  that  the  choice  of  an 
appropriate  experimental  design  will  give  us  direct  estimates  of  the 
experimental  error  for  oUr  estimated  kc  and  kr  values  so  that  we 
can  bypass  the  variance  formula  problem,  < 
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DESIGN  OF  THE  PART  2  EXPERIMENTS.  From  the  statistical 
analysis  it  was  clear  that  the  largest  possible  difference  in  plate  widths 
should  be  used  to  estimate  the  parameters  kc  and  k0  ,  This  consider¬ 
ation  along  with  the  desire  for  a  complete  block  experiment  already  men* 
tioned  resulted  in  a  revision  of  the  choice  of  dimensions  for  the  rectangu¬ 
lar  plates  to  be  used  in  the  experiment.  The  plate  sizes  actually  selected 
are  given  in  Table  1. 


TABLE! 

LIST  OF  PLATE  DIMENSIONS  FOR  PART  2  EXPERIMENTS 


(in 

inches) 

Rectangles: 

1 

X 

4 

2 

x  4 

3 

X 

4 

1 

X 

6 

2 

x  6 

3 

X 

6 

1 

X 

8 

2 

x  8 

3 

X 

8 

Circles:  , 

1 

X 

10 

2 

x  10 

3 

X 

10 

Diameters: 

2 

and  4. 

•*S .1 

The  entire  set  of  plates  thus  provided  14  treatments  to  be  set  up 
in  a  completely  randomized  block  experiment  where  one  block  equals  a 
mix  of  the  soil  bin,  Each  plate  was  to  be  Used  in  a  randomly  selected 
plot  of  Size  about  2'  x  2'  to  make  a  single  measurement  of  the  pressure 
sinkage  curve.  It  was  further  decided  to  complete  six  replicates  which 
would  yield  24  independent  pairs  of  estimates  of  kc  and  k^,  but 
would,  of  course,  yield  84  estimates  of  the  parameter  n,  one  estimate 
being  obtained  from  each  preSBure-sinkage  curve. 


ANALYSIS  OF  RESULTS  FOR  PART  ?,.  Analysis  of  the  estimated 
values  for  n  is  straightforward  and  results  are  readily  interpreted. 

the  k  and  k  -J  v«hiA§  di  ffieulti  e  ■  Bt»i  BP.  PI  noting  ihw  m nan  ft 

is  a  most  useful  device  for  aid  in  understanding  the  effects  indicated  by 
the  analysis. 

Figures  2  and  3  show  the  width  and  length  effects  on  n  without 
considering  the  interaction.  In  order  to  present  the  interaction  effect, 
we  show  the  usual  type  of  plot  for  displaying  an  interaction,  Parallel 
lineB  for  the  various  lengths  of  plate  would  be  indicative  of  no  interaction. 
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Thus,  the  lack  of  parallelism  exhibited  in  Figure  4  is  indicative  of  the 
nature  and  source  of  the  interaction.  The  major  pattern,  however,  is 
still  that  shown  in  Figures  2  and  3.  There  appears  to  be  a  decrease  in 
the  n  values  with  an  increase  in  area  of  plate  whether  the  area  increase 
is  due  to  change  in  length  or  change  in  width.  The  width  effect  is  much 
smaller  in  going  from  2"  to  3",  but  the  length  effect  is  about  the  same 
at  all  widths, 

In  considering  the  analysis  of  the  estimated  kc  and  k<£  values  it 

will  be  useful  to  recall  equations  (2)  and  (3)  which  show  how  the  estimates 
are  obtained.  There  are  some  obvious  points  to  be  noted  from  these 
equations,  but  we  shall  defer  them  until  later.  Each  experimental  unit 
or  plot  in  the  soil  bin  yields  a  p  versus  z  relation  as  drawn  by  the  x,y 
plotter  while  a  single  plate  is  sunk  into  the  soil.  Then  results  from  two 
different  plate  widths  have  to  be  combined  to  obtain  a  single  estimate  of 
kc  or  k  <b  .  We  may  combine  1"  and  2"  widths  or  widths  of  2"  and  3" 
or  1"  and  3".  As  shown  above,  the  latter  is  the  best  choice,  but  we 
see  that  a  single  replicate  or  "set"  will  only  give  us  four  such  indepen¬ 
dent  estimates. 

By  keeping  the  width  difference  constant  and  varying  the  length  we 
can, pair  within  one  set  these  four  pairs  of  plates: 


1  x  4  and  3x4  1x8  and  3x8 

1  x  6  and  3x6  1  x  10  and  3  x  10 


to  give  us  four  pairs  of  estimates  for  k_  and  k^}  ,  Utilizing  the  six 
"sets"  gave  us  24  values  for  analysis.*  Estimates  obtained  from  these 
pairings  may  be  analyzed  for  the  length  effect  alone.  But  we  would  also 
like  to  study  the  width  of  plate  effect  on  these  two  parameters  and  look 
for  interaction,  if  any,  as  we  did  for  the  parameter  n, 

First,  we  consider  the  estimates  of  kc.  The  mean  values  obtained 
for  the  pairs  just  listed  were: 


A  set  consists  of  six  replicates  carried  out  at  the  same  depth.  Eight  - 

teen  reolic&tea  were  arhiallv  rnmnlsfprf  at  sirh  nf  Him  rlontho 

;  ‘  ■  — '  * - - - -  -  — i - -  ■  -as*  .** 

gation  over  six  replicates  forms  a  set.  Thus,  there  are  a  total  of  six 
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Figure  2 


0*  N*  <0  10 

O  (S  K  ri  o 

VALUE  OF  PARAMETER  n 


i 

I 
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WIDTH  OF  PLATE  (inches! 


WIDTH  OF  PLATE  (inches) 


Pairs: 
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1x4  1x6 

1x8 

1  x  10 

•RteA'*' 

and  and 

and 

and 

s  • 

3x4  3x6 

3x8 

3  x  10 

I! 

TT?\  ' 

7 

Mean  Value  of  kc 

We 

frr-' 

fr 

f." 

-3.305  -4.030 

-4, 000 

-4. 166 

'£ 

is 

Relevant  mean  squares  abstracted  from  the  analysis  of  variance  L  Bj  for 

t-  ■ 

comparing  these  means  are: 

b  1 

Source 

d.  f. 

M.  S. 

f 

Length  of  Plate 

3 

0.  8977 

I 

Length  of  Plate  by  Depth 

3 

1.0526 

£ 

i 

\  i 

.,  i 

Length  of  Plate  by  Sets 
within  Depth 

12 

0.  2262 

Since  the  F(F„  „  >  3.89)  «  0.05,  ■ 
*  3, 12  ““ 

we  may  cone 

lude  that  there  is  a  , 

l  length  effect  on  kc  and  that  the  length  effect  ia  not  uniform  at  the  two 

I  deptha  studied  (1.  e.  ,  F  =  3.  97  -  0.  69770.  2262). 


To  extend  our  analyses  other  plate  pairings  were  atudied.  Finally, 
it  seemed  in  our  judgment  that  the  following  paira  were  moat  useful  for 
securing  information  on  the  width  effect  plus  a  little  more  length  infor- 
mation: 


* 


2x4  2x6 

and  and 

3x8  3  x  10 


1  x  4 
and 
2x8 


1  x  6 
and 

2  x  10 


Pairs: 
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Mean  Vaiue  of  kc 

-2.463  -2.495  -5.169  -5.063 

Note  that  the  pairs  selected  show  a  constant  length  difference  of  4  inches 
Furthermore,  the  length  differences  are  balanced  for  comparing  1  and 
2  inch  widths  with  2  and  3  inch  widths  for  the  study  of  the  plate  width 
effect  in  estimating  kc>  It  appears  that  the  latter  effect  is  large. 

Relevant  mean  Bquares  from  the  analysis  of  variance  are  a  a  follows: 


Source 

d.  f. 

M.  S. 

Width  Pairs 

1 

41.  717 

Width  Pai*s  by  Depth 

1 

7. 183 

Length  Differences  within  Width  Pairs 

Length  in  1  and  2 

1 

0.003 

Length  in  2  and  3 

1 

0.034 

Length  Difference 

by  Depth 

in  1  and  2 

1 

0.006 

in  2  and  3 

1 

5.  914 

Experimental  Error 

12 

1,  529 

For  comparing  the  width  pairs  we  obtain  an  F  ratio  =  41.717/1,  5 29>  27. 

We  conclude  that  the  parameter  kc  depends  on  the  choice  of  plate  widths. 
In  estimating  kc,  pairing  of  1  and  2  inch  widths  gives  a  larger  value 
(algebraically)  than  pairing  2  and  3  inch  widths.  Looking  at  it  another 
way  the  data  show  that  changing  the  length/width  ratio  for  the  plates  from 
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the  range  4  to  6  to  a  range  of  2  to  3  materially  alters  the  kc  value 
obtained. 

Similar  analyses  for  the  estimates  of  the  parameter  k  were  carried 
out  aS  just  described  for  kc.  We  note  that  the  k<p  estimates  were  posi¬ 
tive,  mostly  in  the  range  +7  to  +10.  Our  conclusions  about  the  effect 
of  plate  width  on  the  parameter  k<£  were  the  same  as  reached  in  regard 
to  but  no  length  effect  was  detected. 

With  these  results  available  we  may  return  to  the  further  consideration 
of  the  method  used  to  obtain  the  estimates,  First,  we  observe  that  if  there 
were  no  width  of  plate  effect  in  the  p  versus  z  relation,  then  k0  would 
be  equal  to,  say,  p*.  In  the  notation  used  above,  no  width  of  plate  effect 
would  mean  P01aP03'  if  one  inch  and  three  inch  plate  widths  were  used, 
and,  hence,  Pj*  ■  pj#  a  a  common  value,  p*.  Observed  pj#  and  p^# 

values  would  differ,  of  course,  due  to  experimental  variation,  but  average 
values  would  be  equal.  Further,  when  =  p*,  then  the  solution  for  kc 

is  zero.  The  parameter  kc  was  once  regarded  as  a  measure  of  cohesive - 
ness  of  the  soli  and,  hence,  might  be  zero  for  sand  [3j  ,  The  present 
experiments,  in  which  mason's  sand  was  used  certainly  do  not  agree  with 
this  point  of  view  about  the  parameter  kc,  ! 

Recognizing  then  that  the  present  model  for  the  p  versus  z  relation 
does  admit  a  width  of  plate  effect  our  analyses  so  far.  have  indicated  the 
magnitude  of  this  effect,  In  addition,  we  have  obtained  some  indication  of 
a  length  effect  on  kc  although  none  appeared  for  k^, , 

Second,  with  respect  to  the  method  of  obtaining  the  estimates  of  kc 
and  k(p,  we  point  out  that  the  estimates  obtained  are  correlated.  This 
correlation  cannot  be  avoided  because  the  values  are  based  on  the  solution 
of  two  simultaneous  equations,  In  fact,  the  estimatea  also  would  have  been 
correlated  if  we  had  been  able  to  obtain  them  by  a  direct  least  squares 
procedure.  In  the  least  squares  case,  however,  it  is  usually  easy  to  write 
down  the  covariance  of  the  estimates  and,  hence,  to  find  the  correlation 
if  desired.  For  the  two  simultaneous  equations  in  k£  and  k0  ,  matrix 

methods  can  he  applied  to  find  the  covariance  matrix  for  ke  and  k rp  , 

The  result  obtained  for  the  covariance  of  kc  and  k^is 
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(4)  cov(kc,  k<j>)  =  (^S  V(Pl*)  +b1b22V(p2*)) 

where  b2  is  the  width  of  the  larger  plate  and  V(  )  denotes  variance  of 
the  enclosed  quantity. 

It  is  interesting  to  examine  the  consequences  for  different  choices  of 
plate  widths  in  estimating  kfi  and  k£>.  As  a  first  approximation  it  may 

be  adequate  to  assume  V(pj#)  @  V(p2*).  If  this  assumption  is  mads, 
the  following  correlation  values  are  obtained; 

Plate  widths  paired:  (widths  in  inches} 

1  and  3  1  and  2  2  and  3 


Value  of  correlation  of  kQ  and 
-0.  8944  -0.9487  -0.9805 

i,  ' »  ■’ 

>;  '•  ,/  "  “ 

Observed  values  of  the  correlation  between  kQ  and  k^  will,  of  courad, 

differ  from  these  theoretical  values  because  of  experimental  variation  and 
lack  of  equivalence  of  Vlpj*)  and  V(p2*).  It  is  clear,  however,  that  the 

above  results  further  support  the  Use  of  maximum  difference  in  plate  widths 
for  estimation  of  these  parameters.  Actual  plots  of  the  kc  and  pairs 

support  the  high  correlation  of  these  estimates. 


These  considerations  and  the  analyses  for  kc  and  k (p  made  it 
seem  desirable  to  return  to  an  analysis  of  the  84  p*  values  which  corres¬ 
pond  to  the  84  n  values  analyzed  earlier.  Such  an  analysis  should  give  a 
clearer  assessment  of  the  length,  width,  and  interaction  effects  than  W« 


nave  uinsuieu  iru in  analysis  ui  uio 


Any  eiiecis  xouna 


in  this  analysis  must  then  be  present  in  the  kc  and  values  because  '! 

of  the  method  of  derivation  of  /hese  estimates  from  the  p*  values. 
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The  means  for  the  p*  values  are  presented  in  Table  Table  3 
following  gives  the  analysis  of  variance  for  the  p#  values.  From,  the 
table  of  means  it  is  seen  that  the  width -of -plate  effect  is  much  larger 
than  the  length-of-plate  effect.  Both  effects,  however,  may  be  judged 
significant  from  the  analysis  of  variance  results.  It  is  interesting  to 
note  that  the  length  by  width  interaction  mean  square  is  so  small)  no  In¬ 
teraction  is  indicated.  This  result  is  in  contrast  to  the  analysis  of  the  n 
values,  Table  4,  for  which  the  Interaction  effect  was  judged  significant. 

CONCLUSIONS  FOR  PART  2.  A  large  series  of  experiments  have 
been  conducted  to  study  the  pressure  versus  sinkage  relation  and  to  esti¬ 
mate  the  parameters  in  this  relation,  The  experiments  ware  carried  out 
using  a  relatively  homogeneous  soil  material,  dry  mason's  sand.  Bearing 
plates  used  comprised  two  circles  of  2  and  4  inch  diameters  and  12 
rectangular  plates  varying  in  size  from  l  x  4  to  3  x  10  inches 
(refer  Table  1  for  list  of  plate  sizes.  )  Thus,  the  length  over  width  ratio 
of  the  plates  ranged  from  a  maximum  of  10  to  1  down  to  4  to  3,  or 
from  long  narrow  plates  to  almost  square  plates.  This  range  of  length 
over  width  ratios  was  selected  to  cover  the  range  from  tracked  vehicles 
to  wheeled  vehicles  with  tires, 

From  the  estimates  of  k,,  kA  ,  and  n  plus  the  estimated  pressures 
for  one  inch  sinkage  our  analyses  show  that:  ;| 

(1)  The  parameter  n  varies  with  the  width  and  length  of  plate*  For 
one  inch  width  of  plate  the  n  value  was  0.  83;  at  three  inch  width, 

y  the  value  was  0,68,  Between  2"  and  3!’  width  there  was  little 
change.  With  length,  n  varied  from  0, 18  to  0.  70  over  lengths 
of  4"  and  10".  The  decrease  was  nearly  uniform  over  the  6" 
interval. 

(2)  The  estimated  pressures  for  one  Inch  of  sinkage  (the  p*  values) 
show  variation  with  both  length  and  width  of  plate  but  ho  interaction 
of  the  factors  is  indicated.  (Refer  to  Tables  2  and  3. ) 

(3)  The  parameter  kc  decreases  algebraically  with  increase  in  plate 
length.  The  algebraic  change,  however,  was  much  greater  whim 
estimates  were  compared  from  pairing  of  platen  nf  1"  and  ?" 
widths  with  estimates  obtained  by  pairing  2"  and  3"  widths. 

(4)  The  parameter  k<£  showed  little  or  no  response  to  length  of 
•  plate  but  a  large  response  to  width  of  plate. 


lisiVi!  j  )8»iiairttB»Magnj.'^j — : - ^ . ... 
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(5)  The  estimates  of  and  are  highly  correlated.  ThiB 

correlation  is  negative  so  that  when  kc  increases  in  value  k^ 
decreases  in  value. 

From  these  analyses  it  appears  that  the  p  versus  z  relation  in  the 
general  farm  p  »  (k^  f  kc/b)zn  is  inadequate  to  predict  the  pressure - 

sinkago  response.  Although  not  pointed  out  previously  in  this  paper,  it 
should  be  mentioned  that  our  analyses  to  date  are  based  only  on  the  experi 
mental  results  for  sinkage. in  the  range  0.6"  to  2".  Perhaps  it  should 
be  added  that  Dr,  Bekker  has  not  claimed  that  his  equation  would  be  ade> 
quite  in  the  entire  -£/ b  region  we  have  studied. 

1  (i 

FUTURE  WORK.  While  much  has  been  learned,  there  is  clearly 
need  for  the  following: 

a.  Similar  laboratory  experiments  in  other  soil  media. 

b.  Experiments  with  greater  depth  differences  in  the  soil  bins  to 
asaeso  the  depth  effect,  if  any,  on  the  parameters  under  homo- 
geneoua  soil  conditions. 

c.  Revision  of  the  model  to  take  account  of  the  dimensions  of  the 
bearing  surface. 

d.  Improvement  of  the  model  to  cover  a  wider  range  in  depth  of 
sinkage,  say,  from  at  least  0.5  to  5.0  Inches. 


Table  2 
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TABLE  OF  MEANS  FOR  p*  VALUES 

(estimated  pressure  tor  one  inch  sinkage) 
summarized  by  plate  dimensions  (inches) 


SiAt  Of-  PLATE 

P* 

COMBINED  MEANS  p* 

Circles 

all  Circles 

6.865 

2"  diameter 

5.509 

4"  " 

8.222 

Rectangles 

1x4 

5.188 

Lengths  (over  all 

Widths) 

1  x  6 

4.889 

4 

6.429 

'  1  X  8 

4.701 

6 

6.378 

1  xIO 

4.737 

8 

6.296 

2x4 

6.706 

10 

6.141 

2x6 

6.671 

2  x  8 

6.420 

Widths  (over  all.. 

Lengths) 

xIO 

6.1  70 

1 

4.928 

3x4 

7. 3  92 

2 

6.492 

.3x6 

7.576 

3 

7.512 

■3'x8 

7.568 

3x10 

7.515 

Table  3 

ANALYSIS  OF  VARIANCE  OF  p*  VALUES 
{estimated  pressure  for  one  inch  sinkage) 


SOURCE  OF 

VARIATION 

DEGREES  OF 
FREEDOM 

MEAN 

SQUARE 

Plates 

(13) 

8.4927 

Circles  vs  Rectangles 

1 

23279 

Between  Circles 

1 

22.0784 

Among  Rectangles 

(1  1) 

7.6181 

Widths 

.  2 

409546 

Lengths 

■  3 

0.4964 

.  Length  by  Width 

6 

0.0668 

Plates  by  Depth 

(13) 

02290 

Experimental  error 

52 

0.1793 

Table  4 


ANALYSIS  OF  VARIANCE  OF  ft  VALUES 

(estimated  from  six  replicates  grouped  to¬ 
gether  for  fitting  the  pressure- sinkage 
equation  in  double-iog  form) 


SOURCE  OF 

VARIATION 

Degrtes  of 
FREEDOM 

MEAN 

SQUARE 

Plates  (13) 

Circles  vs  Rectangles 

1 

O.OII2 

Among  Circles 

1 

0.1248 

Among  Rectangles  (m) 

Widths 

2 

0.1113 

Lengths 

3 

0.0228 

Lengths  by  Widths 

b  .. 

0.0193 

Plates  by  Depth 

13 

aooio 

Experimental  Error 

52 

0.0037 
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EFFECTIVENESS  OF  CERTAIN  EXPERIMENTAL  PLANS 
UTILIZED  IN  SENSORY  EVALUATIONS 

J.  Wayne  Hamman  and  Jan  Eindhoven 
Armed  Forces  Food  and  Container  Institute 
Chicago,  Illinois 

First,  I  would  like  to  present  some  specific  purposes  of  sensory 
testing  at  the  Armed  Forces  Food  and  Container  Institute.  This  will  be 
followed  by  a  discussion  of  the  experimental  results  obtained  from  the 
sensory  evaluation  of  four  meat  products. 

SOME  PURPOSES  OF  SENSORY  TESTING,  You  are  aware  of  the 
numerous  food  items  developed,  purchased,  stored  and  consumed  by  the 
Armed  Forces.  A  continuous  program  exists  at  the  Institute  to  deter¬ 
mine  whether  or  not  differences  in  quality  or  stability  exist  between  dif-  ' 
ferent  samples  of  food.  Hern  are  some  of  the  most  common  requirements 
for  conducting  these  sensory  tests: 

1.  Pre-award  evaluation  for  intent  to  purchase.  When  a  certain 
food  item  (such  as  peanut  butter)  is  required  by  the  Army,  it  advertises 
for  bids  from  manufacturers.  Those  manufacturers  who  are  interested 
submit  samples  of  their  products  for  preference  evaluation.  These 
samples  are  taste-tested,  and  those  that  are  reliably  poorer  than  our 
standard  products  are  rejected.  In  this  way,  sensory  testing  Screens 
out  lower  quality  products  that  are  relatively  unacceptable  to  the  soldier  - 
consumer, 

2,  Storage  stability.  Since  foods  may  not  be  used  for  several  years 
after  they  are  packed,  a  considerable  amount  of  research  is  devoted  to 
extend  the  shelf-life  of  a  food,  Sensory  tests  are  concerned  with  the 
preference  or  intensity  of  off-flavor  changes  that  take  place  during 
storage.  Sensory  tests  are  made  on  foods  stored  at  different  temperatures 
oVer  time  up  to  two  years,  and  more. 

3.  Packaging  studies.  Often,  a  flexible  package  may  be  desired  for 
use  in  the  field.  However,  the  relative  storage  life  of  food  in  such  a 
plastic  package  must  be  considered  if  a  change  is  to  be  made  from  a 

- -  j  r —  j 

v.»m*uu  ivvu« 

4,  Processing  variables.  New  processing  and  preservation  methods 
of  foods,  such  as  freeze -dehydration  of  meats,  offer  new  problems  in 
flavor  and  texture  for  evaluation.  It  rrxust  be  determined  whether  or  not 
this  new  product  is  as  desirable  as  the  existing  food  prepared  by  other 
methods. 
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5,  Special  Purpose  Foods.  Recent  evaluations  have  included  novel 
preparations  of  foods  designed  specifically  for  space  flight.  For  example, 
meat  dishes  that  may  be  consumed  through  a  straw.  Also  the  new  Quick- 
Serve  Meals  have  been  developed  which  consist  largely  of  pre-cooked  de¬ 
hydrated  foods.  Preliminary  testing  is  done  first  at  the  Institute  to  deter¬ 
mine  whether  or  not  these  foods  are  satisfactory  enough  for  further  testing 
in  the  field  among  astronauts  and  soldiers. 

SENSORY  EVALUATION  LABORATORY.  In  the  sensory  evaluation 
laboratory  careful  attention  is  given  to  assure  that  each  sample  of  food 
is  treated  in  the  same  way  as  every  other  one  in  an  evaluation.  Some  of  the 
procedures  followed  include 

1.  The  random  assignment  of  code  numbers  to  the  samples  so  that 

subjects  will  not  be  biased.  '  1 

2.  In  order  for  the  individual  to  regain  sensitivity,  that  Is  U>  get  the 
flavors  of  a  previous  sample. out  of  his  system,  a  30-second  time  interval 

is  specified  between  the  time  that  a  subject  returns  the  rating  of  hi*  previous 
sample  and  when  he  receives  his  next  one,  Automatic  timers  are  used. 

3.  In  a.  sensory  test  each  sample  is  served  first,  second,  third,  etc,, 
an  equal  number  of  times  to  minimize  position  effect.  When  the  number 
of  subjects  permits,  all  possible  serving  sequences  of  samples  are  used, 
to  reduce  both  serving  position  and  sequence  biases  that  might  exist, 

'4.  The  number  of  samples  that  a  subject  receives  is  normally  limited 
to  four  in  order  to  minimize  effects  of  fatigue  and  to  maintain  interest  in  the 
evaluation.  t 

PURPOSE  OF  EXPERIMENT.  This  experiment  is  concerned  with  the 
effect  on  sensory  results  when  meat  samples  are  presented  to  subjects  in 
different  combinations  and  sequences.  Specific  topics  considered  are 

1.  Sequence  effects.  How  is  the  rating  of  a  sample  Influenced  by  the 
quality  of  a  preceding  sample?  It  is  hypothesized  that  when  more  highly 
preferred  samples  precede  those  of  relatively  low  preference,  the  differ¬ 
ence  between  them  is  emphasized.  It;  is  further  hypothesized  that  when 

the  more  highly  preferred  samples  follow  thoep  of  icui lively  low  preference, 
the  difference  between  them  is  reduced. 

2.  Position  effect*.  How  is  the  rating  of  a  sample  influenced  by  the 
number  of  preceding  samples  he  has  evaluated? 
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3,  Matnitude  of  error  term.  How  is  the  size  of  the  error  term  af- 
fected  by  the  quality  and  sequences  of  the  samples  presented? 

MATERIALS  AND  METHODS.  Four  meat  products  were  evaluated  in 
this  experiment:  ham,  pork,  chicken  (white)  and  chicken  (dark).  Four 
samples  of  each  of  the  meat  products  consisted  of  two  control  and  two 
treated  samples.  An  additional  preparation  variable  was  included  for 
each  meat  product  which  causes  both  the  two  control  samples  and  the  ,wo 
treated  samples  to  be  considered  as  non-duplicates.  However,  the  de¬ 
termination  of  the  effect  of  the  additional  variable  is  not  the  intent  of  this 
experiment  and  will  not  be  specifically  considered  in  this  paper, 

The  subjects  sat  in  a  semi-enclosed  testing  booth  for  privacy  in 
making  evaluations.  Each  individual  received  four  samples  of  one  of 
these  meat  products.  These  samples  were  presented  one  at  a  time  through 
a  turn-table  in  a  vi>al,l  separating  the  booth  from  the  serving  and  preparat¬ 
ion  area.  The  subject  was  asked  to  state  his  preference  for  each  sample 
on  a  nine-point  rating  scale.  The  terminology  on  this  hedonic  scaled) 
ranged  from  dislike  extremely,  coded  1,  to  like  extremely,  coded  9,  and 
is  shown  on  the  illustrated  EAM  card  (Figure  1)  [Figures  and  Tablet 
can  be  found  at  the  end  of  this  article]  which  it  used  for  rating  andmSe 
chtmica],  data  reduction. 

Subjects  were  selected  at  random  from  a  pool  of  about  450  employees, 

EXPERIMENTAL  PLANS.  Five  experimental  plans  are  considered: 

(1)  41  :  Conventional  plan  with  all  sequences  of  serving  orders, 

Twenty-four  subjects  are  required  for  this  plan  in  order  to  encompass  ail 
sequences, 

( 2 )  cccc:  Two  control  samples  balanced  over  four  serving  positions, 
The  two  control  samples,  you  will  recall,  are  the  non-treated  samples 
and  differ  by  a  preparation  variable. 

(3)  tttt:  Two  treated  samples  balanced  over  four  serving  positions. 

(4)  cctt:  Two  control  samples  followed  by  two  treated  samples.  The 
two  control  sampleB  were  served  equally  often  in  positions  1  and  2;  the 
two  corresponding  treated  samples  were  served  equally  often  in  positions 
3  and  4. 
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(5)  ttcc:  Two  treated  samples  followed  by  two  control  samples. 
The  two  treated  samples  were  served  equally  often  in  positions  1  and  2; 
the  two  corresponding  control  samples  were  served  equally  often  in 
positions  3  and  4. 


Twenty-four  subjects  were  selected  at  random  for  each  of  these 
plans;  all  plans  were  carried  out  for  each  of  the  four  products, 

EXPERIMENTAL,  DESIGN.  A  latin  square  experimental  design^ 
was  utilized  in  this  study  in  order  to 

a.  determine  the  effect,  if  any,  of  the  sequence  of  the  presentation 
on  the  rating  for  a  sample,  and 

b.  reduce  the  experimental  error,  if  a  position  effect  was  present. 

Six  replications  of  a  4x4  latin  square  design  were  Utilized  in  each 
plan, 

Figure  2  illustrates  the  allocation  of  samples  for  the  4!  conventional 
plan  which  has  all  possible  sequences.  Subjects  1,  2,  3,  4,  constitute 
the  first  replication,  then,  and  the  four  samples  A,  B,  C,  D,  all  occur 
once  in  each  order  in  a  replicate  and  a  subject  receives  all  four  samples. 
The  basic  Analysis  of  Variance  components,  before  isolating  certain  in¬ 
dividual  degrees  of  freedom  is  also  given  as  a  part  of  Figure  2.  Sihde 
the  subjects  in  a  replicate  were  selected  at  randbm,  no  difference  was 
anticipated  between  replicates.  In  the  Analysis  of  Variance  treatment  x 
replication  and  order  replication  interactions  were  pooled  into  the 
error  term,  since  there  is  no  reason  to,  expect  that  these  interactions 
are  real, 

SEQUENCE  RESULTS.  Results  for  the  conventional  plan  (41)  which 
had  all  serving  orders  are  shown  in  Table  1.  Mean  preference  scores 
for  controls  were  higher  than  treated  for  all  four  of  the  meat  products. 

The  mean  differences  ranged  from  0.  36  to  0.79  scale  points  and  signi¬ 
ficance  values  were  no  larger  than  P  =  .  06  in  testing  the  null  hypofchi**i*  , 
namely,  that  the  control  mean  and  treated  mean  are  the  same. 

Tabie  2,  which  presents  results  for  the  plan  with  two  control  samples 
served  first  followed  by  two  treated  samples,  shows  a  substantial  in¬ 
crease  in  the  discrimination  between  control  and  treated  samples.  The 
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comoined  mean  difference  increased  from  0,69  for  the  conventional  plan 
to  1.  00  for  this  cctt  plan  and  individual  probability  values  declined  with 
the  exception  of  pork  which  remained  about  the  same  (P  =  .01  vs  .  02), 

This  phenomenon  has  been  described  in  previous  studies, 

(4) 

In  a  study  with  soups  and  beverages  the  situation  of  poor  samples 
following  good  ones  was  termed  "contrast",  that  is,  one  of  emphasizing 
differences.  An  explanation  hypothesized  for  the  phenomenon  of  "contrast" 
was  that  the  positive  qualities  of  the  good  sample  are  either  noticed  to  be 
absent  or  bad  qualities  are  noticed  as  present  In  the  pooir  one,  thus 
emphasizing  in  either  case  the  short-comings  of  the  less  preferred  one. 

Results  of  the  alternative  situation  where  relatively  poor  samples 
precede  the  good  ones  are  given  in  Table  3,  You  will  notice  that  the 
direction  of  the  differences  determined  in  the  conventional  41  and  con¬ 
trast  plans  are  not  found  here.  The  combined  treated  samples  were 
rated  0,  06  scale  points  higher  than  the  control  Jin  this  ttcc  plan  and  none 
of  the  individual  product  differences  were  statistically  significant.  This 
situation  where  poor  samples  preceded  good  ones  was  termed  "conver¬ 
gence"^  ,  although  with  these  liquids,  convergence  effects  wars  not 
found  to  be  statistically  significant.  An  explanation  hypothesised  is  that 
the  presentation  of  a  "poor"  sample  Increases  an  individual's  awareness 
of  the  presence  of  some  of  the  negative  characteristics  in  a  "good" 

sample'^), 

Conclusions  drawh  from  these  results  might  be  modified  somewhat, 
after  a  consideration  of  the  position  of  presentation.,,  We  might  ask  the 
queationt  what  part  of  the  observed  contrast  and  convergence  effects 
might  b<*  due  to  the  fact  that  samples  were  presented  in  positions  i  and  47 
We  willi  now  proceed  to  an  examination  of  the  positional  effect  of  presen¬ 
tation. 


POSITIONAL  RESULTS.  An  examination  of  the  effect  of  the  order 
in  which  the  sample  was  received  on  its  rating  has  been  made,  considering 
ail  five  plans.  Mean  scores  by  position  are  given  in  Table  4,  Combined 
positional  means  are  given  in  the  lower  part  of  this  Table  for  each  type 
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H1 

1  *1* 

*2 

H2 

:  x^  > 

*4 

h3 

:  *1  +  2 

>  * 

Since  it  was  theorized  that  the  position  effect  (if  one  existed)  may  be 
dependent  upon  the  quality  of  the  product,  data  were  analyzed  separately 
for  the  control  (cc),  treated  (tt)  and  the  mixed  sequence  (ct  or  tc).  These 
are  the  breakdowns,  then,  in  Table  5.  The  orthogonal  comparisons  are 
shown  here  for  positions  1  vs  2,  3  vs  4  and  1  +  2  vS  3+4,  relating  to  the 
mean  scores  of  Table  4. 

Probabilistic  results  from  these  similar  experiments  of  ham,  pork, 
chicken  (white),  and  chicken  (dark)  were  combined^3)  in  order  to  strengthen 
evidence  concerning  an  effect  of  position. 

Combined  evidence  for  the  control  (cc)  type  pairing  demonstrated  a 
decrease  in  preference  from  position  3  to  4  (P  =  .06)  and  from  the  first 
two  positions  to  the  second  two  positions  (P  «  .  05).  Evidence  was  not 
conclusive  oonceming  the  decrease  in  preference  exiblted  from  position 
1  to  2  (P  a  ,  12).  In  the  latter  case  the  decrease  was  0.  22  scale  points 
and  was  in  the  hypothesized  direction. 

Combined  evidence  for  the  treated  (tt)  type  pairing  did  not  demon¬ 
strate  significant  positional  effects.  In  the  all  treated  plan  the  mean  for 
the  first  two  positions  was  6.  74  contrasted  with  6,  70  iot  the  last  two 
positions  which  is  reflected  by  chi-square  probability  of  0,48,  Also 
the  differences  between  mean  preferences,  regarding  positions  1  vs  2  and 
3  vs  4,  were  not  statistically  significant. 

In  the  mixed  pairing  (ct)  position  1  was  shown  to  be  significantly 
higher  than  position  2  (P  s  ,  03)  and  the  first  two  positions  significantly 
higher  than  the  last  two  positions  (P  =  .  03).  Little  difference  was  evi¬ 
denced  between  means  for  positions  3  and  4,  however. 

(71 

A  taste  testing  experiment  was  reported  previously'  '  which  studied 
the  effect  of  fatigue  over  a  series  of  eight  samples  presented  in  one  sitiipg. 
The  two  foods  considered  were  canned  sauerkraut  and  canned  bread  with 
margarine.  In  a  comparison  of  serving  positions  1  or  3  with  5  or  8, 
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there  was  found  to  be  no  significant  difference  in  preference  rating  due  to 
the  position  of  the  teat  food,  whether  it  appeared  early  or  late  in  the 
eight  sample  series.  These  results  on  the  treated  samples  (no  significant 
difference  between  positions)  would  seem  to  bear  out  those  found  on 
sauerkraut  and  margarine,  since  these  food  items  are  all  relatively  low 
preference  items,  particularly,  the  margarine  of  ten  years  ago. 

Credulence  is  lent  to  the  theory,  then,  that  while  a  position  effect 
does  appear  to  exist,  the  quality  of  the  sample  determines  whether  or  not 
there  is  a  decline  in  preference  with  the  sequence  of  presentation, 

MAGNITUDE  OF  ERROR  TERMS.  A  comparison  of  the  magnitude  of 
errpr  terms  for  the  different  plans  is  presented  in  Table  6.  In  an  analysis 
of  Variance  of  these  variances  followed  by  a  Duncan  Multiple  Ranged 
test  of  means  it  was  determined  that  th«  variance  for  the  all  control  plan 
was  significantly  (P  a  .  05)  smaller  than  the  three  plans  having  both  con¬ 
trol  and  treated  samples.  Also,  the  error  variance  of  the  all  treated  plan 
was  significantly  (P  =» .  05)  smaller  than  for  the  conventional  Al  and  the 
plan  with  two  control  samples  followed  by  two  treated  samples  (cctt). 

These  results  are  in  line  with  anticipations,  however,  since  the 
ranges  of  ratings  of  individuals  within  the  all  treated  and  all  control  plane 
are  lese  than  for  the  other  plans,  Hence,  the  magnitude  of  disagreement 
in  preference  would  be  expected  to  be  lees  for  these  plan*.  The  difference* 
in  magnitude  of  these  variances,  though,  do  point  out  the  necessity  for 
analysing  differences  between  means,  such  at  those  for  order,  individually, 
for  each  plan. 

SUMMARY.  The  preference  rating  ecale  is  normally  used  for  com¬ 
parative  purposes  between  samples.  However,  one  can  see  the  effect 
that  might  occur  on  the  magnitude  of  scores  of  experimental  samples, 
depending  upon  the  quality  of  standards  or  controls  with  which  they  are 
compared. 

Also  the  sequence  in  which  relatively  good  and  poor  samples  were 
presented  made  a  considerable  difference  in  what  conclusions  would  be 
drawn.  Evidence  concerning  the  effect  of  the  position  uf  ^i  cncntaiion 
was  given.  For  the  higher  preference  samples  it  was  demonstrated  that  a 
fatigue  effect  or  sensitivity  effect  was  present  Causing  a  decline  in  the 
rating  of  subsequent  samples  (although  not  so  conclusive  between  positions 
1  and  2  where  P  =  .  12).  For  the  lower  preference  samples  there  was 
not  determined  to  be  a  decline  in  ratings  in  subsequent  positions. 
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If  one  desired  to  minimize  Type  II  statistical  error  (acceptance  of 
the  null  hypothesis  when  it  is  false),  then,  one  would  wish  to  present 
test  samples  after  the  standards.  If  the  test  samples  were  poorer,  the 
difference  would  be  emphasized  by  a  contrast  effect  pointed  out  earlier. 
The  statistical  soundness  of  such  a  procedure  might  be  questioned, 
however,  since  the  magnitude  of  the  contrast  effect  would  be  expected  to 
be  greater  when  the  difference  between  samples  waa  greater.  This  would 
affect  the  probability  statements  concerning  a  "true"  difference  in  the 
population  to  a  corresponding  unknown  degree, 
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FIGURE  2.  Allocation  of  Saaples  tor  the  4!  Sxperiawctal 
Plan  Utilising  a  Latin  Square  Design 
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TAELS  1 .  Meta  Preference  Ratings  of  Four  Meat  Staples  in  All  Possible  Serving 

Orders,  Termed  a  41  flan* 


Z$SH _ 

Control 

Treated 

Control  - 
Treated 

Biff. 

Signif. 
Level 
for  Biff. 

Baa 

7.17 

6#46 

0.71 

.04 

Fork 

6.56 

5.77 

0.79 

.01 

Chicken,  W. 

7.33 

6.77 

0.56 

.02 

Oenbined 

6  #75 

6.06 

0.69 

0.69 

.06 

TAELS  2.  Keen  Trefwfenoe  eatings  of  Pour  neat  ianpies  Where  Two  Control  flat  plea 
Were  Preaented,  Followed  »jr  Two  Treated  Saeplee,  Tamed  a  oott  Plan* 

food 

lit  A  2nd 

Petition 

Control 

3rd  6  4th 

Poe it ion 

Treated 

Control  - 
Treated 

Signif. 
Level 
for  Biff 

Has 

7.40 

5.75 

1.65 

.001 

Pork 

6,5a 

5.0S 

0.6* 

.02 

Chicken,  W. 

7.14 

6.3? 

0.79 

.005 

Chicken.  0. 

Ooabined 

'  6»71 

5# SI 

It 2L 

1.00 

.005 

YAllX  3<  Mean  Preferanee  Ratings  of  Four  Neat  Sanplea  Vbere  Two  Treated  Sanplea 
Were  Presented,  Followed  Bjr  Two  Control  Sanplea ,  Tamed  an  ttoe  nan* 


Food 

tat  t  2nd 

Poe  it  ion 
treated 

3rd  A  4th 
Position 

Control 

6,60 

Control  - 
Treated 

Biff. 

Signif. 
Level 
for  Biff. 

Man 

6.S5 

-0.25 

■  n*a*. 

Pork 

5.96 

5.92 

•0.0* 

n.a. 

Ohio ken,  w. 

6*90 

7.0* 

0,1* 

n.a. 

ft&teai.P,?. 

Oenbined 

5.90 

5.83 

■sML  „ 
-0.06 

n.a. 

•Individual  Hmum  represent,  ratjnn  nt  9  aaaples  by  24  subjects. 
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TABLE  4.  Mean  Preference  Ratings  for  Eaoh  Serving  Order 

of  Four  Meat  Products  for  Five  Experimental  Plans . 
Individual  Means  Represent  24  Subjects • 


5 


| 

I 

£ 


Food 

wugn— 

&«/ 

_LaL 

Hta 

41 

7.71 

oeoo 

7.46 

tttt 

7.12 

ectt 

7.71 

ttoo 

6.54 

Pftrfe 

i  • 

*** 

6.25 

COOP 

6.62 

tttt 

6.50 

oott 

6.58 

tide 

5*75 

Chloksn.  V. 

41 

7.20 

0000 

7.58 

tttt 

6.88 

oott 

7.42 

ttoo 

6.83 

Chiakan,  D< 

4« 

7,.lfc 

OOOfl 

6.83 

tttt 

6.50 

oott 

6.67 

ttoo 

6.04 

Oanhined 

4* 

7.07 

r  *  t2 

tttt 

6.75 

oott 

7.10 

ttoo 

6,29 

Order  of  Presentation 


8nd  3rd  4th 

6.87  6.21  6,46 
7.42  7.37  7.21 
7.21  6.83  6,96 
7.08  5.90  6.00 
7.17  6,62  6.58 


'tw  6*38  6.17 
6.54  6.79  6.88 
6.29  6.21  6.90 
6.47  5.79  6.00 
6.17  6.17  9.67 


7.04  6.71  7.25 
7,46  7.29  6.92 
7,04  7.00  6,92 
6.88  6.38  6.33 
6.96  7.17  6.92 


6.12  6.38  6.00 

6.50  6.71  6.33 

6.46  6.63  6*33 

6.75  5*98  6.04 

5-75  6.08  5.58 


6.48  6.42  6.47 

V.7D  7*04  D.K 

6.74  6,72  6.68 

6,80  5.80  6,09 

6.51  6.51  6.19 


i 


i 
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TABLE  5«  Probability  Value**  for  Qrthogr/aal  CoKpariaon*  of 
Position  Effect  of  Kean  Preference  Bating*  in  Which 
Four  Moat  Saaplee  Ware  Pros anted  to  a  Subject 


f} 

r- 

Pairing 

00 

t« 

<% 

ff. 

Poeition 

Meat  ( 

Han 

-L 

3 

JL  JL 

-L 

w 

1  Vs  3 

Ban 

.11 

•44 

.95  .60 

.19 

Park 

.38 

.39 

.33  .31 

.18 

f 

Chloken,  V. 

•err 

•33 

.66  .73 

.39 

£  ' 
h 

V 

VJ 

Chicken,  B. 

X4  Ooab'd  ? 

JS 

.13 

.37 

d21  M 

.61  .61 

.03 

.03 

V-  ■ 

(*ia) 

(.62) 

i 

BwB 

jL 

3 

rn^Lm 

X 

a 

J» »  4 

Hen 

.44 

.33 

.33  >64 

.70 

ftrk 

.14 

.33 

.75  .33 

.35 

Ohlekan,  V. 

.33 

.03 

.44  .36 

.96 

Chiskeot  B. 

i°2 

M  Jl2S 

.33 

1*  (kab«d  ? 

.10 

.10 

.93  .41 

.56 

i. 

(.05) 

(.79) 

| 

Plan 

jr 

mJL» 

1+2  n  >4 

Ben 

.33 

.19 

.006 

Park 

.33 

•45 

.77 

i 

Chioken,  W. 

.013 

.50 

.36 

gMrtWiJk 

.33 

M 

iiL 

X1  Ooab'd  P 

.06 

•46 

.03 

a 

1 

I 


I 


•Probability  Value*  Presented  in  This  Table  Refloat  the  Test  of  Sifnifleanoe 
Regarding  the  Hypotheses  of  xj  >  *j  ,  *•}  >  and  £|+2  >  . 

Combined  Results  Were  Obtained  by  the  Chi-Square  Method  of  Coabining  Reaulte  of 
Similar  Experiments  (3) .  Individual  Probebilitiee  in  tha  Table  are  Baaed  on  an 
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TABLE  6.  Error  Term*  fr on  Five  fep*riaeat*l  Plant 
«nd  Four  Meat  Product* 

l 


Htafc  Product* 


£3A8l/ 

am 

-ten.. 

Brtfthta.  ¥| 

OhlokwuD. 

OaaeMlt* 

41 

2.7386 

1.9697 

1.1203 

2.9246 

2.1883 

oott 

3*0890 

1.6721 

1.4883 

1.9670 

2*0531 

ttoo 

1.6356 

2.5553 

1.1933 

1.5490 

1.7333 

tttt 

1.6360 

1.1497 

0.8085 

1.4420 

1.2590 

0000 

0.9134 

1.0659 

0.7993 

0.9171 

0.9239 

*Braokat*d  matbtrt  indieat#  th*  rtrianott  which  art  not  aigaificantljr 
dlfftraat  at  th*  probability  Itval  of  0.05* 


in  ! 


AN  EVALUATION  OF  RADIATION-PROCESSED  FOODS 
FOR  MILITARY  RATIONS* 

Donald  M.  Boyd 
Research  Analysis  Corporation 
Bathesda,  Maryland 

In  the  fall  of  I960  a  research  group  from  our  organisation  (then  known 
as  ORO)  was  asked  to  investigate  the  possible  operational,  logistical,  and 
economic  advantages  to  the  armed  forces  of  employing  radiation-processed 
foods  in  the  military  feeding  system  and  to  provide  a  basis  to  assist  the 
Army  in  making  decisions  on  the  irradiated-food  research  program. 

The  preservation  of  food  by  sterilisation  with  ionising  radiation  is  a 
relatively  new  concept  and  at  that  time  had  not  been  attempted  commer¬ 
cially,  Experimentally,  many  foods  have  bssn  irradiated  to  determine 
the  value,  safety,  and  efficacy  of  such  processing.  Various  radiation 
doses  have  been  employed  under  different  conditions  of  exposure  and  of 
associated  treatment  techniques.  The  ultimate  goal  is  the  attainment  of 
a  process  that  would  safely,  and  at  a  reasonable  cost,  preserve  foods  so 
that  they  could  be  stored  in  a  fresh-like  and  wholesome  condition  for  long 
periods  of  time  without  refrigeration.  Because  meats  are  the  highest- 
valued  items  in  military  rations,  special  research  efforts  have  been 
placed,  on  the  development  of  radiatlon-proceeaed  meat  items  for  ration 
components. 

'  '  ■  •  .  C  . 

Considerable  progress  has  besn  made  since  The  Quartermaster 
General's  extensive  research  program  on  irradiated  foods  began  in  1953. 
However,  their  plans  for  the  construction  and  operation  of  a  develop¬ 
mental  pilot  plant  were  indefinitely  suspended  on  the  recommendation  of 
the  Director  of  Research  and  Development  of  the  Army,  in  1939.  This 
action  was  taken  partly  because  of  the  uncertainty  of  the  wholesomenesg 
of  the  foods,  but  mainly  on  the  basis  of  need  for  adequate  reliable  infor¬ 
mation  concerning  the  operational,  logistical,  and  economic  advantages 
that  would  justify  the  use  of  irradiated  foods  in  military  rations  and  the 
construction  and  operation  of  a  pilot  plant.  In  March  i960,  a  revised 
Army  program  on  radiation  preservation  of  foods  was  approved  for 
wholesomenese  studies  and  fundamental  res>  *rch  toward  development  of 


$ 

The  data  presented  in  this  paper  have  been  published  in  greater  detail 
as  ORO -S P-17 4,  "Radiation-ProceBsed  Foods  as  a  Component  of  the 
Armed  Forces  Feeding  Systems,  "  August  1961. 


388  Design  of  Experiments 

end  items.  The  Operations  Research  study,  undertaken  by  RAC,  was 
included  in  the  plan  of  that  new  program. 

Our  investigation  began  with  an  analysis  of  the  technological  status 
of  radiation-preservation  of  foods  and  the  additional  research  effort 
needed  to  attain  fully  acceptable  products  for  incorporation  into  military 
rations  during  the  1965-1975  time  frame.  Attention  was  given  to  various 
concepts  of  military  feeding  and  the  tactical  operational  requirements  of 
various  armed-forces  units  for  ration  support.  Then  particular  con¬ 
sideration  was  given  to  the  logistical  implications  involved  in  the  inte¬ 
gration  of  irradiated  components  in  military  rations,  including  savings 
in  manpower,  storage,  equipment  and  supplies.  The  costs  of  processing, 
storing  and  transporting  irradiated  foods  were  concurrently  studied  and 
our  estimates  compared  with  estimated  costs  of  the  free  sc- dehydration 
process,  and  the  costs  of  the  commercial  canning  and  freezing  processes. 

An  examination  was  also  made  of  the  different  types  of  radiation 
sources  that  could  be  used  for  processing  foods,  and  of  the  availability, 
costs,  and  efficiency  of  these  radiation  sources. 

Asa  last  step,  wo  investigated  the  feasibility  of  establishing  a  mo¬ 
bilization  base  containing  irradiated  meats  as  ration  components,  and 
estimated  the  number  and  cost  of  accelerators  needed  for  a  production 
base. 

Our  findings  were  published  in  August  of  last  year. 

In  order  to  be  approved  by  the  Food  and  Drug  Administration,  ir¬ 
radiated  foods  for  public  consumption  must  not  show  radioactivity  levels 
that  are  distinguishable  from  background.  Reports  have  shown  that  foods 
can  be  processed  by  gamma  radiation  from  Co°^  or  by  electron  accel¬ 
erators  below  energy  levels  of  10  Mev  without  inducing  measurable  radio¬ 
activity  in  the  foods.  Radiation  preservation  of  meats  requires  an  ex¬ 
posure  dose  of  about  4.  5  megarads  preceded  by  short  heating  to  an  in¬ 
ternal  temperature  of  about  160°  F,  Reports  showed  that  beef  and  pork 
processed  this  way  had  remained  acceptable  for  at  least  25  months  at  7C"F 
storage  temperature  and  for  16  months  at  1Q0°F.  Bacon  and  ham  had 
been  stored  about  one  year  and  chicken  for  one  and  one-half  years  with 
good  acceptability. 

We  found  that  numerous,  extensive  Btudies  to  determine  the  whole- 
sn meneee  of  irradiated  foods  hs.d  been  conducted,-  both  in-house  and 
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under  contract  to  the  Army  Guartermaster  Corps  and  the  Surgeon 
Generali 


Objective  analyses  of  the  results  of  these  studies,  including  long¬ 
term  animal  feeding  tests,  showed  no  harmful  effects  attributable  to 
radiation  processing  beyond  correctable  vitamin  loss*  However,  pru¬ 
dently  cautious  recommendations  by  the  Surgeon  General  included  a  few 
more  years  of  research  for  completion  of  the  wholeiomenass  study 
program. 


In  the  future  feeding  concept  shown  in  Fig,  1,  single  meal  modules 
would  be  employed  as  follows:  i. 

(a)  The  25-in-l  uncooked  meal  might  be.used  behind  the  contact 
area.  This  ration  will  contain  canned,  dehydrated,  and  irradiated 
foods,  and  will  be  served  by  trained  food  service  personnel  in  a  unit" 
mess  type  of  feeding. 

(b)  From  the  reserve  area  forward  into  the  contact  area  the  25- 
in-1  precooked  quick-serve  meal  would  be  used  where  the  tactical  situ¬ 
ation  precludes  the  preparation  and  serving  of  the  25-ln-l  uncooked  meal. 
This  ration  will  contain  preoooked  freese -dehydrated  foods  as  the  major 
component,  which  will  be  prepared  by  one  or  two  individuals  by  pouring 
hot  water  directly  into  the  food  packages  and  serving  it  on  disposable 
trays  packed  in  the  carton  with  the  meal.  Trained  food  service  per¬ 
sonnel  would  not  ordinarily  be  involved,  Under  some  circumstances 
precooked  irradiated  meats  might  be  used  in  place  of  free  as -dehydrated 
meats, 


(c)  In  situations  where  small  groups  are  dispersed  from  their  units 
for  long  periods,  the  6-in-l  preoooked  ready-lu- serve  meal  would  be 
used.  It  will  contain  the  same  type  of  foods  at  the  25-in-l  meal, 

(d)  In  the  contact  area  especially  and  under  certain  conditions  to  the 
rear,  the  tactical  situation  will  often  require  the  use  of  an  individual 
ready-to-eat  meal,  This  will  contain  precooked  irradiated  foods  that 
will  normally  be  eaten  cold  but  could  be  warmed  by  the  individual  when 
his  situation  will  allow  it.  Flexible  packaging  will  add  to  the  value  of 
this  ration. 

(e)  Individuals  would  also  be  issued  an  individual  combat  food  packet 
for  emergency  use.  This  will  be  a  small,  compressed,  high-caloric- 
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content  tood  item  totalling  about  1000  calories,  Tbis  is  not  intended  to 
replace  a  meal  whan  other  rations  can  be  provided  but  is  to  be  capable 
of  sustaining  a  man  for  as  long  as  2  to  10  days  under  emergency  situ¬ 
ations  without  appreciable  loss  of  efficiency  and  without  irreversible 
physiological  damage. 


A 


B  ration 

1 

n 

< _ 

Canned  5 -in-1  ration 

> 

T  — 1 - 

C _ 

C  ration 

As  suit 
food 


<  > packet 


Contact 

Area 


25-in-l  precooked  meal 


6-in-l  precooked  meal 


i 


'C  Individual  ready-to-eat  meal  > 


<dZ> 


Combat 

food 

packet 


Fig,  1  --  Present  and  Future  Feeding  Concepts 


With  the  current  emphasis  on  mobility  of  US  forces  vs  enemy  mass 
a  continuing  requirement  exists  for  improved  logistical  operations  to 
support  such  mobility.  This  requirement  pervades  all  classes  of  supply. 
Although  class  I  supply  involves  only  a  small  fraction  of  the  tonnage  of 
class  III  fuels,  simplified  rations  do  contribute  to  reducing  fuel  consumpt¬ 
ion  as  well  as  equipment  and  manpower  requirements,  and  to  improving 
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In  seeking  a  logistical  advantage  of  employing  irradiated  rations, 
we  estimated  the  potential  savings  these  rations  would  permit  if  the 
logistic  burden  of  field  kitchens  could  be  eliminated  from  forward  units. 
An  Army  of  2  million  men  was  considered,  using  a  distribution  of  men 
in  a  theater  based  on  data  from  FM  101-10,  as  shown  in  Tables  I  and  II, 


TABLE  I 

COMPOSITION  OF  THEATER  SLICE  BY  ASSIGNMENT 


Assignment 

Troops 

Basic  division 

13,961 

Nondivision 

18,540 

Theater  overhead 

24,790 

Army 

(10,750) 

Air  Force 

(14,000)11 

Total 

57,251 

‘Two  Air  Force  wings  including  Army  support. 


V1 
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TABLE  II 


COMPOSITION  OF  AN  OVERSEAS  ARMY  SI4CE 


Item 

Division 

Corps* 

Army 

(rounded)'3 

Men 

Armor 

14, 600 

14, 600 

Infantry 

13, 748 

41, 244 

Corps,  nondi vision 

... 

74, 160° 

... 

Theater  overhead 

— 

99, 0QQd 

... 

Total 

229,004 

687,000 

Field  Kitchens 

Armor 

&,  ■ 

98 

98 

Infantry 

7  b 

237 

... 

Total 

335 

1,005 

Bakery  companies 

(mobile) 

-  -  - 

•s  si  m 

5 

Refrigeration  companies 
(mobile) 

■fW1  ''l'  " 

m  m  m 

1 

aCorpa  has  three  infantry  division*  and  one  armored  division  plus  non¬ 
division  troops. 

'’Army  has  three  corps. 
cl)fi,  540  X  4 
-24,750  x  a. 

In  Tabla  III  can  be  seen  the  requirements  for  the  operation  of  field 
kitchens  for  2  million  men  in  a  theater  of  operations.  Of  particular 
importance  is  the  fuel  consumption  rate  of  over  65,000  tons  per  year, 
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TABLE  III 


REQUIREMENTS  FOR.  FIELD  KITCHENS 
(For  2  million  men  overseas) 


Item 

No.  of  field  kitchens 

2, 925a 

Men 

14,625 

Trucks 

2,925 

|  Water,  millions  of  gal/year 

Equipment 

21 3C 

Men 

80d 

Total 

293 

Fuel,  tons/year 

Trucks 

4, 100® 

Cooking 

56,000f 

Pump  water 

5, 1 30® 

Total 

65,230 

“From  Table  II  (1005  x  (2  x  106))  /687,00Q  -  2925  field  kitchens, 
^Based  on  five  men  per  field  kitchen. 

0 Based  on  200  gal/ day/ kitchen  for  washing  and  rinsing  mess  trays 
plus  all  else  not  consumed  directly  by  men. 

^Based  on  15  gal/man/day.  Truck  water  requirements  are  small  in 
comparison. 

eBased  on  2000  miles/year/ truck,  average  fuel  consumption  of  5 
miles/gal,  and  7.  0  lb/ gal, 

%ased  on  15  gal/ day/kitohen, 

8 Based  on  1  gal  of  fuel  required  to  pump  200  gal  of  water  at  the 

water  source. 


The  requirements  for  mobile  bakery  companies  are  shown  in  Table  IV. 
These  companies  bake  bread  for  troops  in  the  field,  but  may  also  be 
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assigned  to  supplement  the  production  of  garrison  bakery  units  as  the 
situation  demands.  During  overseas  use  these  bakeries  require  over 
8,  000  tons  per  year  of  fuel  per  2  million  men. 

TABLE  IV 

REQUIREMENTS  FOR  MOBILE  BAKERY  COMPANIES 
(for  2  million  men  overseas) 


Item 

Quantity 

No.  of  bakery  companies 

15* 

Men 

2130b 

Trucks 

315c 

Water,  millions  of  gal/year 

Equipment 

39  d 

Men 

12* 

T  otal 

51 

Fuel,  tons/year 

Trucks 

2200f 

Ovens 

1150* 

Electric  generators 

3950h 

Pump  water 

890* 

Total 

8190 

aFrom  Table  II  (5  x  (2  x  10^))/687,  000  =  14.  6  bakery  companies. 

L 

“Based  on  142  men/company. 


cBased  on  21  trucks/ company. 

d- 

jsased  on  1UU  gal/ hr/ platoon  and  three  platoons  per  company. 

eBksed  on  15  gal/man/day.  Truck  water  requirements  are  small  in 
comparison. 


^ Based  on  10,  000  miles/year/truck,  average  fuel  consumption  of  5 
miles/ gal,  and  7.  0  lb/ gal. 


8n„  „„  j  i  a  —1/ j _ i 

W«l  *  V - - - 


(jcu t  uo,yf  Ovo«  0.11a  six.  uvcnB  per  company. 


i 

1 

1 
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^Based  on  three  generators  {25  Kw  each)  per  company  running  contin¬ 
uously;  specific  fuel  consumption  *  0,  6  lb/hp-hr. 

1Based  on  1  gal  of  fuel  required  to  pump  200  gal  of  water  at  the  water 
source. 

Mobile  refrigeration  companies  deliver  perishable  foods  from  depots 
to  supply  points,  but  many  also  use  their  semitrailer  vans  as  fixed  re¬ 
frigerators  as  the  situation  demands.  During  use  in  the  theater  of  oper¬ 
ations,  these  companies  require  fuel  for  gasoline -driven  refrigerant 
compressors  and  trucks.  These  requirements  are  illustrated  in  Table  V, 
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TABLE  V 

REQUIREMENTS  FOR  MOBILE  REFRIGERATION  COMPANIES 
(For  2  million  men  oversees) 


Item 

Quantity 

No.  of  refrigeration  companies 

Man 

564b 

Trucks  \ 

165® 

Water  for  men,  millions  of  gal/ year 

Fuel,  tons/year  \ 

3d 

Trucks  \ 

1,150® 

Refrigeration  equipment  \ 

Pump  water 

lw.wvO1 

50®  ... 

Total 

11,800 

aprom  Table  II  (1  x  (2  x  10^))/ 687, 000  ■  2,  9  refrigeration  companies. 

bBaeed  on  188  men/ company. 

°Ba*«d  on  55  trucks/ company,  of  which  40  are  7  1/2-ton  semi¬ 
trailers  and  7  are  2  1/2-ton  trucks. 

dBased  on  15  gal/man/day.  Truck  water  requirements  are  small  in 
comparison, 

®Basad  on  10,000  mile/year/ true  k,  average  fuel  consumption  of  5 
miles/gal,  and  7.  0  lb. /gal  for  both  truck  types, 

IBased  on  5-hp  motors,  specific  fuel  consumption  of  0.  6  lb/hp-hr,  and 
7000  hr/year  of  operation. 

aDasau  on  1  gal  uf  fuel  required  to  pump  200  gal  of  water  at  the  water 
source. 


Design  of  Experiment*  397 

If  the  use  of  irradiated  foods  and  freese-dehydrated  food*  would 
permit  the  elimination  of  refrigerated  warehouses,  a  substantial  saving 
in  the  overseas  logistical  effort  shown  in  Table  VI  could  be  attained. 


TA  BLE  VI 

REQUIREMENTS  FOR  REFRIGERATED  WAREHOUSES 
(For  2  million  men  overseas, 
warehouse  sise,  20  by  100  ft) 


Item 

Quantity 

No.  of  refrigerated  warehouses 

173 

Msn 

819* 

Water,  millions  of  gal/ysar 

Equipmsnt 

Man 

3b 

Total 

9 

Fuel,  tona/year 

Electricity  generation 

12,700 

Pump  water  '  ' 

100® 

Total 

u.aio 

*Ba«ed  on  three  men  per  warehouse  (ORO  estimate). 
bBased  on  19  gal/ mm/ day. 

c Based  on  1  gal  of  fuel  required  to  pump  200  gal  of  water  at  the  water 
source. 


Table  VH  summarises  those  requirements  for  kitchens,  bakeries,  and 
refrigeration  facilities  which  could  be  reduced  from  the  total  logistical 
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effort  by  employment  of  irradiated  foods  and  dehydrated  foods  in  mili¬ 
tary  rations.  Net  savings  that  could  be  attained  in  fuel  alone  are  shown 
in  Table  VIII.  The  delivery  of  bulk  fuel  by  truck  is  one  of  the  largest 
problems  in  theater  logistics, 

TABLE  VII  | 

REQUIREMENTS  FOR  KITCHENS,  BAKERIES,  AND 
REFRIGERATION  FACILITIES 
(For  2  million  men  overseas) 


,  Facility 

Men 

Trucks 

Water  ,,  millions 

Fuel 

of  gal/ year  tons/year 

Field  kitchens 

2925 

293 

Bakery  companies 

2,130 

3  15 

51 

Refrigeration  companies 

564 

165 

3 

11,800 

Refrigerated  warehouses 

519 

0 

9 

12,  800 
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TABLE  VIII 

NET  FUEL  SAVINGS 
(For  2  million  men  overseas) 


Item 

Fuels  saved, 
tons/year 

Field  kitchens 

65  ,.230 

Bakery  companies 

8,  190 

Refrigeration  companies 

10,600* 

Refrigerated  warehouses 

12,700® 

Total  for  irradiated  foods 

96,720° 

Preparation  of  freeze -dehydrated  food 

-5,08Qd 

Total  for  freeze -dehydrated  foods 

91,640* 

ft 

Refrigerating  equipment  only. 

^Refrigerating  equipment  only.  All  electricity  generation  is  kfliumed 
to  be  for  refrigeration  purpose*. 

c Fuel  for  electricity  for  truck  shops  is  less  than  0.  5  percent  of  this 
total, 
d 

Fuel  consumed  in  heating  of  water  for  freeze -dehydrated  foods. 

Corresponds  to  250  tons/day  and  is  not  sensitive  to  the  assumed  per¬ 
centage  of  men  who  may  eat  freeze -dehydrated  food  regularly.  For 
example,  50  percent  freeze-dehydrated  food  in  a  theater  yields 
96,720  -  10,  X 60  =  86,  560  tons/year,  which  corresponds  to  237 
tons/day. 


Our  coal  analysis  for  processing  and  transporting  irradiated  foods 
showed  that  these  costs  were  similar  and  competitive  to  those  of  freeze  - 
dehydrated  foods  and  foods  preserved  by  other  commercial  means. 
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Our  analysis  of  costs  of  operation  of  electron  accelerators  included 
the  result  that  the  cost  of  these  machines  per  kilowatt  of  output  power 
decreases  with  the  increase  in  the  power  rating  of  the  accelerator.  In 
addition,  at  any  given  radiation  dose  the  output  in  terms  of  food  pro¬ 
cessed  is  proportional.  When  we  applied  our  operational  costs  analyses 
to  the  problem  of  establishing  a  mobilization  base,  we  found  that  seven 
100-Kw  accelerators  or  twelve  30-Kw  accelerators  would  be  required 
to  process  the  total  ar.taual  meat  ration  requirements  per  1  million  men 
(Fig.  2).  The  costs  of  processing  this  amount  of  meat  is  shown  in 
Table  IX. 


Fig.  2  --  Number  of  Accelerators  Needed  to  Treat  Meats 
for  Armed-Forces  Personnel 
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TABLE  IX 

ANNUAL  CAPITAL  AND  OPERATING  COSTS  FOR  MEAT  PROCESSING 

(In  millions  of  dollars) 


aNo  amortization,  operating  coat*  only. 


The  QMC  generally  stock*  meat  reserves  in  a  15-month  supply 
(compo*ed  of  a  12-month  operational  reserve  plus  a  3-month  safety' 
reserve).  We  determined  that  a  mobilization  base  reserve  of  15  months' 
rations  containing  irradiated  meat  components  could  be  obtained  by  es¬ 
tablishing  a  production  base  and  operating  for  one  year  nine  100-Kw 
electron  accelerator*  per  million  men  supplied. 

About  2  years  of  total  lead  time  would  be  required  to  establish  the 
production  base  and  produce  the  15 -month  reserve  supply. 

It  is  likely  that  only  50%  of  the  meat  components  of  future  rations  in 
this  system  would  contain  irradiated  meats;  the  rest  being  processed  by 
other  means.  Under  this  consideration  the  electron  accelerators  re¬ 
quired  for  the  reserve  supply  would  be  reduced  to  5. 

The  results  of  our  studies  permitted  us  to  m.-ike  rprtain  conclusions, 
some  of  which  were  as  follows: 
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CONCLUSIONS. 

1.  The  use  of  rations  containing  irradiated  foods  instead  of  B  and  C 
rations  and  the  elimination  of  field  kitchens  in  general  war  could  result 
in  logistical  savings  equivalent  to  97,000  tons  of  fuel/year/2  million 
men  in  tha  theater  of  operations. 

2.  The  logistical  savings  gained  by  employing  onily  dehydrated  foods 
instead  of  B  and  C  rations  would  be  equivalent  to  91.000  tons  of  fuel/ 
year/ 2  million  men. 

3.  In  1965 - 397 5  irradiated  foods  could  have  a  distinctive  advantage 
over  all  other  types  of  foods  in  providing  an  operationally  suitable  in¬ 
dividual  combat  meal  that  would  be  well  received  by  fighting  men. 

4.  Tha  estimated  cost  of  radiation  processing  of  foods  would  be 
competitive  with  the  costs  of  the  thermal-canning,  freezing,  and  freeze- 
dehydration  processes, 

5.  About  2  years  would  be  required  to  obtain  a  mobilization  base 
composed  of  a  15  -  month  reserve  supply  of  rations  with  irradiated  meats 
comprising  50  percent  of  the  meat  components.  This  time  includes  the 
estimated  9  to  12  months  required  to  establish  radiation  facilities  and 
the  12  months  required  to  process  the  rations, 

6.  Tq  process  the  15-month  supply  of  rations,  five  100-Kw  ac- 
celers, tors/million  men  would  be  required  at  a  cost  of  $1  million  to 
$1,6  million. 
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A  CRITIQUE  OF  THE  EVIDENCE  RELATING  DIET  AND 
CORONARY  HEART  DISEASE 

George  V.  Mann 

Division  of  Nutrition,  Vanderbilt  University 
School  of  Medicine 
Nashville,  Tennessee 

It  may  be  useful  for  me  to  review  the  problem  of  coronary  heart 
disease  (CHD)  from  the  special  viewpoint  a  nutritionist.  While  this 
view  may  have  some  prejudice  it  seems  relevant  because  of  the  frequent 
association  of  diet  with  CHD  and  the  widespread  lay  interest  in  the  pro¬ 
blem. 

Coronary  heart  disease  may  seem  to  have  risen  like  an  epidemic 
among  us,  It  is  a  complicated  task  to  determine  whether  this  rise  to 
prominence  is  real  or  only  made  apparent  by  changing  techniques.  It 
would  be  an  interesting  task  for  someone  to  relate  the  time  course  of  the 
prevalence  of  CHD  to  the  marketing  of  electrocardiographs.  To  my 
knowledge  this  has  not  been  done.  ,  One  might  have  expected  a  rise  of 
CHD  when  the  ECG  became  available  for  diagnosis.  Dr,  Lew  of  the 
Metropolitan  Life  Insurance  Company  has  shown  a  remarkable  explan¬ 
ation  for  the  distribution  . by  states  of  coronary  heart  disease  in  the 
United  States  (1){2),  (Fig.  I  and  II),  It  must  be  clear  that  we  see  what 
we  look  for. 

•  A  more  subtle  influence  is  that  of  "competing  causes"  (3).  Even 
when  age  specific  rates  are  considered  we  may  be  baffled  in  understanding 
the  entire  effect  of  the  removal  of  diseases  which  typically  kill  at  an 
earlier  age  than  does  coronary  heart  disease. 

The  error#  of  reporting  cause  of  death  are  well  known  (4).  It  is  less 
than  even  money  that  an  autopsy  will  confirm  the  clinical  impression  and  \ 
only  a  email  proportion  of  all  deaths  are  followed  by  necropsy.  Since  ' 
reporting  causes  of  death,  like  ladies  hats,  tends  to  change  with  fashion  y 
it  is  easily  possible  for  the  mortality  rptes  to  be  strongly  influenced  by 
the  current  fashion  and  this  is  conveniently  done  since  the  selection  of  f 
the  first  cause  in  the  presence  of  multiple  causes  of  death  will  dateT-mine 
the  final  tabulations. 


Finally  we  must  concede  that  it  is  possible  that  an  apparent  rise  of 
prevalence  of  coronary  heart  disease  is  real  and  that  this  is  a  reflection 
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of  the  introduction  of  a  new  and  potent  causal  factor  that  we  must  iden- 
tify  and  adjust  in  order  to  control  CHD. 

The  interest  of  nutritionists  in  this  problem  like  their  interest  in  most 
diseases  stems  from  the  ancient  judgement  that  a  man  may  be  sick  be¬ 
cause  of  "something  he  et".  This  explanation  has  proved  so  attractive 
that  we  have  a  second  epidemic,  a  scourge  of  nutritionists.  These  new¬ 
comers,  coupled  with  the  food  industries,  have  made  food  and  feeding  a 
highly  complicated  and  even  dangerous  business. 

The  essential  series  of  hypotheses  upon  which  most  research  is 
presently  based  may  be  shown  as  follows: 

1  2  3 

Diet  Hypercholesteremia  Atherosclerosis  Clinical  Events 

The  evidence  to  Support  the  first  relationship  is  at  best  indecisive. 

The  question  was  brought  to  prominence  by  A.  Keys  (5)  who  based  this 
contention  on  a  curious  selsctlon  of  food-mortality  data  of  the  World 
Health  Organisation  (Fig.  Ill),  Aside  from  the  fact  that  the  hypothesis 
is  based  on  tenuous  population  data  that  might  as  easily  be  explained 
in  other  ways  (6)  it  has  proven  Impossible  to  show  In  retrospective 
studies  that  persons  with  CHD  eat  differently  than  those  without  (Fig,  IVp. 

The  dietary  behavior  of  9B3  persons  in  the  Framingham  Study  has 
been  measured  by  Georgian*  Pearson  in  the  past  four  years  (7)(8)(9). 

The  reproducibility  of  the  method  whether  by  one  person  (Fig,  V)  or  by 
a  second  observer  (Fig.  VI)  is  good.  We  arc  confident  that  these  people 
were  well  classified  but  we  can  find  no  relationship  between  either 
cholesterol  level  (Table  1)  or  experience  with  CHD  and  the  way  these 
people  eat.  Morris,  Marr  and  Heady  (10)  have  found  no  diet-cholesterol 
disease  relationship  in  their  population  of  bank  clerks  (11).  Their 
method  of  measuring  diet  does  not  reproduce  quite  as  well  as  ours. 

(Table  2). 

The  entire  problem  is  complicated  by  the  prevailing  imprecision  of 
the  measurement  of  cholesterol.  Consider,  for  example,  the  data  of 
Rivin  (12)  (Table  3)  who  compares  hospital  and  commercial  laboratories. 

We  have  compared  several  methods  applied  in  a  research  setting  (13) 

(Table  4),  If  one  adds  to  this  technical  variation  the  considerable  bio¬ 
logical  variation  of  serum  cholesterol  with  time  (14)  it  is  clear  that  the 


Design  of  Experiments 


405 


central  element  of  the  hypothesis  may  be  so  badly  estimated  that  this 
disqualifies  our  most  convenient  index  (Table  5). 

We  are  at  least  as  bad  off  in  measuring  atherosclerosis,  the  ana¬ 
tomical  lesion  we  believe  to  be  the  basis  for  the  clinical  disorders.  We 
cannot  visualize  these  lesions  in  life  and  even  after  death  to  do  more 
than  make  qualitative  descriptions  is  difficult.  You  can  appreciate  that 
an  element  of  probability  determines  whether  the  plaque  is  critically 
placed  in  the  cardiovascular  system. 

The  clinical  manifestations  of  CHD  are  varied  (Table  6),  A  dis¬ 
turbing  number,  disturbing  at  least  for  the  biometrician,  ar*  completely 
occult  events  called  "silent  coronaries"  because  they  do  not  causa  im¬ 
portant  clinical  signs.  The  cerebral  events,  strokes,  are  even  more 
obscure  because  we  have  less  precise  ways  to  determine  and  localize 
these,  having  no  equivalent  for  the  ECO, 

There  are  several  prospective  dietary  studies  under  way  which  pro¬ 
pose  to  change  the  experience  with  CHD  by  altering  the  d(et,  The  dietary 
regimens  of  some  of  these  are  summarized  in  Table  7.  The  VAopt  am¬ 
bitious  of  these  called  the  National  Diet  Heart  Disease  Study  is  directed 
by  Dr.  Irvine  Page  and  sponsored  by  the  National  Heart  Institute  (15). 

It  is  now  in  the  feasibility  phase,  that  is,  the  determination  of' whether 
families  can  be  recruited,  supplied  with  suitable  food  and  kept  under 
surveillance  while  consuming  the  diet  for  the  measurement  oi  choles- 
teremia  and  the  evaluation  of  cardiovascular  dlspase  status.  If  proven 
feasible,  this  experiment  will  be  extended  to  larger  numbers  in  order 
to  answer  the  critical  question- -will  dietary  ahanges  modify  the  course 
of  CHD? 


The  smaller  trials  of  diet,  for  example,  that  of  Dayton  at  Los  Angeles 


(16)  and  Rinzler  with  the  Anti -Coronary  Club  (17)  in  New  York  have 
usually  obtained  about  a  15%  reduction  of  serum  cholesterol  in  the  best 
circumstances,  that  is,  when  the  starting  level  is  high.  However,  many 
subjects  who  do  follow  the  diet  do  not  respond  and  some  who  respond 
initially  drift  back  up  with  time.  We  must  conclude  that  dietary  treat¬ 
ment,  if  effective,  is  a  relatively  impotent  :  agent.  We  must  conclude 
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diatary  modifications  are  proving  relatively  ineffectual  control  measures. 
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SOME  CONSEQUENCES  OF  SOME  ASSUMPTIONS 
WITH  RESPECT  TO  THE  PHYSICAL  DECAY 
OF  A  CHAMBER  AEROSOL  CLOUD* 

Theodore  W,  Horner* 

Project  Statistician,  Booa-Allen  Applied  Research,  Inc.  , 

4815  Rugby  Avenue,  Bethasda,  Maryland 

The  usual  piece  of  equipment  for  studying  the  survival  character- 
sitics  of  organisms  suspended  in  an  atmosphere  is  a  gas-tight  chamber 
controlled  with  respect  to  relative  humidity  and  temperature.  The 
mathematical  formulation  of  the  behavior  of  aerosol  clouds  injected  in¬ 
to  these  chambers  and  the  viability  of  organisms  contained  in  the  parti¬ 
cles  of  these  clouds  are  of  great  interest  to  aerobiologists.  This  paper 
is  concerned  with  some  of  the  consequences  of  a  particular  set  of  assumpt¬ 
ions  with  respect  to  the  physical  decay  of  chamber  aerosol  clouds.  In 
presenting  the  material,  1  will  first  touch  on  those  aspects  of  chambers 
and  aerosol  clouds  that  must  be  taken  into  consideration  in  mathemati¬ 
cal  formulations.  Biological  recovery  curves  will  be  touched  on  next. 

A  discussion  of  relationships  among  parameters  associated  with  the 
physical  recovery  of  the  cloud  will  follow  --  hitting  first  the  mathemati¬ 
cal  characterisation  of  the  assumptions,  then  the  mathematical  relation¬ 
ships  among  the  parameters  and  finally  by  means  of  slides,  the  relation¬ 
ships  will  be  pointed  up  visually.  The  paper  will  conclude  with  a  short 
discussion  of  possible  applications  of  the  work  and  an  indication  of  further 
work  that  remains  to  be  done. 

Chambers  vary  enormously  in  size,  Usually  they  are  cylindrical  in 
shape,  being  oriented  either  horizontally  or  vertically.  Occasionally 
they  may  have  a  spherical  or  some  other  type  of  shape.  The  chamber 
may  or  may  not  be  revolving.  In  using  a  chamber  the  procedure  is  to 
disseminate  an  aerosol  cloud  from  a  liquid  slurry  containing  viable  or¬ 
ganisms  into  the  chamber. 

The  aerosol  cloud  is  composed  of  liquid  droplets  and  the  disseminating 
device  produces  a  spray  from  the  liquid  slurry  which  is  similar  to  the  or¬ 
dinary  nose  spray  used  to  fight  the  common  cold;  Immediately  after  dissem¬ 
ination,  the  suspended  particles  start  disappearing  from  the  chamber  due 
to  gravitational  fallout  and  impingement  on  the  aides  of  the  chamber.  Since 
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the  larger  particles  fall  more  rapidly  than  the  smaller  particles,  the 
distribution  of  particle  sizes  in  the  aerosol  cloud  changes  with  time. 

The  usual  assumption  is  that  the  particle  number  distribution  is  log  nor¬ 
mal  immediately  after  dissemination.  The  fraction  of  those  particles 
with  radii  between  r  and  r  +  dr  is  £(r)  dr  where  f(r)  is  the  frequency 
density  function  of  the  particle  number  distribution.  Because  of  the  dif¬ 
ferential  fallout  of  the  various  sized  particles,  the  particle  number  distri¬ 
bution  does  not  remain  log  normal,  The  usual  expression  for  differential 
fallout  is 

2 

h(r,  t)  p  exp  (-Kr  t) 


where  h(r,  t)  is  the  fraction  of  those  particles  with  radii  between  r  and 
r  +  dr  that  remain  suspended  at  time  t  of  those  suspended  initially. 

K  is  a  constant  that  depends  on  chamber  dimensions,  gravitational  accel¬ 
eration  and  other  factors,  This  formula  which  traces  to  Stokes  law  was 
first  derived  for  stirred  stationary  chambers  by  Boyd#.  Later  Calder#* 
showed  that  a  similar  formula  held  for  revolving  chambers, 

Immediately  after  dissemination  the  aerosol  particles  undergo  an 
equilibration  process  with  respect  to  their  moisture  content  and  the  cham¬ 
ber  atmosphere.  This  process  ordinarily  is  accomplished  in  about  a 
second  and  00  it  is  convenient  to  refer  to  time  zero  as  that  instant  at 
which  the  equilibration  process  is  completed.  Both  the  equilibration  and 
th«  di» ■emulation  process  are  quite  drastic  events  in  the  life  of  an  organ¬ 
ism  and  so  it  is  not  surprising  that  many  organisms  which  were  viable  in 
the  slurry  are  dead  at  time  zero,  The  organisms  continue  to  die  after 
time  zero.  The  percentage  of  those  organisms  which  were  viable  in  the 
slurry,  which  remain  viable  at  time  zero  is  known  as  the  iritial  recovery 
percentage. 

The  biological  recovery  percentage  is  the  ratio,  expressed  in  per¬ 
centage  form,  of  the  number  of  viable  suspended  organisms  at  time  t  to 
the  number  of  suspended  organisms  at  time  t.  In  this  definition  only  the 


^Boyd,  Charles  A.  ,  ''The  Theory  of  Sedimentation  and  Decay  of  Aero¬ 
sols”,  Interim  Report  BLIR-7,  Fort  Detrick,  July  1952. 
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organisms  which  were  viable  in  the  slurry  are  considered.  We  will  re¬ 
present  the  biological  recovery  percentage  as  B(t)  and  thus 


B(t)  =  lOO 


Number  of  viable  and  suspended 
organisms  at  time  t  _ _ 

Number  of  suspended  organisms 
at  time  t 


Characteristics  of  the  biological  recovery  curve  B(t)  as  it  varies 
with  chamber  size  and  shape,  relative  humidity,  temperature,  organism 
and  slurry  additives  are  of  great  interest  to  investigators  studying  the 
viability  of  organisms  suspended  in  an  atmosphere.  The  typical  biological 
recovery  curve  when  plotted  versus  time  on  semileg  paper  is  concave  up¬ 
ward.  An  estimate  of  the  biological  recovery  percentage  at  time  t  de¬ 
pends  on  data  from  a  sample  of  the  aerosol  cloud  withdrawn  from  ths  cham¬ 
ber  at  time  t. 

There  appear  to  be  a  ntl’mber  of  empirical  mathematical  expressions 
that  do  an  excellent  job  of  fitting  biological  recovery  data.  These  express¬ 
ions  will  often  explain  99.  8  per  cent  of  data  variability.  The  expressions 
generally  have  no  theoretical  basis  and  give  rise  to  differing  consequence  a. 
Thus  inferences  based  on  these  empirical  curves  are  always  suspect. 

As  a  step  toward  deriving  biological  recovery  curves  from  a  more 
fundamental  foundation,  BAAR1NC  suggested  some  time  back  the  heterog¬ 
eneous  initial  recovery  model.  The  model  postulates  that  the  concave  up¬ 
ward  curvature  of  semilog  plots  is  due  to  nothing  more  complicated  than; 


( 1)  Distribution  of  particle  sizes, 

(2)  Differential  fallout  of  the  various  sized  particles,  and 

(3)  Higher  initial  recovery  percentages  for  organisms  contained 
in  the  larger  particles. 


I 


These  three  assumptions  are  sufficient  to  generate  the  type  of  curva¬ 
ture  normally  observed.  There  appears  to  be  no  question  about  the  first 
two  postulates.  The  validity  of  the  third  remains  to  be  proven,  although 
it  does  appear  to  be  quite  reasonable  to  the  aerobiologista  with  whom  1 
have  been  in  contact. 


! 


8 
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Essentially  the  heterogeneous  initial  recovery  model  state  ip  that  the 
biological  recovery  percentage  at  time  t  is  a  weighted  average  of  the 
biological  recoveries  associated  with  the  various  sized  particles.  The 
weights  are  the  fractions  of  the  suspended  organisms  that  are  contained 
in  the  various  sized  particles.  These  weights  continuously  change  with 
time.  The  mathematical  formula  for  the  biological  recovery  percentage 
at  time  t  is 


(1)  B(t)  =  B(r,  t)  a 


where  B(r,\  t)  is  the  biological  recovery  percentage  for  organisms  con¬ 
tained  in  pai’ticles  with  radii  between  r  and  r  +  dr,  The  number  of  or¬ 
ganism  a  contained  in  a  particle  of  radius  r  is  assumed  to  be  proportional 
to  the  radius  raised  to  the  e*h  power,  Some  work  by  Dr,  William  G,  Day* 
at  Fort  Detrick  tends  to  indicate  that  s  may  be  different  from  3, 


The  weights  mentioned  a  few  moments  ago  are  indicated  by  the 
trapezoid  drawn  in  the  equation  above,  To  point  up  the  logic  of  these 
weights,  we  let  N  be  the  number  of  suspended  particles  at  time  zero. 
Nf(r)  dr  is  then  the  number  of  suspended  particles  with  radii  between  r 
and  r  +  dr  at  time  zero,  Multiplication  of  Nf(r)  dr  by  h(r,  t)  yields  the 
number  of  suspended  particles  at  time  t  with  radii  between  r  and  F  +  dr. 
Further  multiplication  by  ar*  yields  the  number  of  suspended  organism*. 
Hence  the  denominator  of  (l)  is  the  number  of  suspended  organisms  at 
time  t  and  the  trapezoid  ratio  is  the  fraction  of  suspended  organisms 
contained  in  particles  with  radii  between  r  and  r  +  dr. 

From  equation  (1),  it  it  evident  that  characteristics  of  the  biologi¬ 
cal  recovery  curve  are  intimately  tied  to  the  physical  aspects  of  the 
cloud.  In  any  case  an  understanding  of  these  physical  aspects  must  pre¬ 
cede  attempts  to  ascertain  the  validity  of  the  heterogeneous  initial  re- 
covery  modei. 

#  „ 

This  work  is  described  by  Horner  in  a  Biomathematics  Analysis  Note. 

Horner,  Theodore  W.  ,  Fort  Detrick,  Maryland,  Biomathematics  Analysis 
5082,  "A  Relationship  Between  Spore  Number  and  Particle  Size",  Septem 
ber  14,  1961. 
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What  are  reasonable  assumptions  and  what  are  their  consequences. 

It  appears  reasonable  to  assume  that  £(r)  is  log  normal  and  h(r,  t)  is  of 
the  form  exp  (-Kr2t).  Further  the  mass  of  a  particle,  say  m(r)  is  prob¬ 
ably  proportional  to  the  cube  of  the  particle  radius. 

To  check  the  validity  of  these  assumptions  and  to  estimate  the  rele¬ 
vant  parameters  is  not  easy  for  three  reasons: 

(1)  The  particle  number  distribution  does  not  remain  log  normal. 

Fart  of  the  present  investigation  was  designed  to  gain  an  understanding 
of  the  extent  of  this  non-log  normality. 

(2)  Chambers  cannot  be  sampled  at  time  zero  and  hence  estimates 
of  the  parameters  of  the  log  normal  distribution  at  time  zero  must  be  ob¬ 
tained  by  indirect  means  based  on  data  collected  after  time  zero, 

(3)  The  physical  recovery  fraction  of  the  cloud,  involves  still  another 
factor;  namely,  the  mass  of  the  particle. 

The  physical  recovery  fraction,  normalized  to  lOO  per  cent  recovery 
at  time  zero,  is  given  by  the  formula 

p  oo 

\  Nf(r)  h(r,  t)  br3  dr 

Jo 

(2)  R(t)  - - 

Nf(r)  br3  dr 

*1 

The  mass  of  a  particle  ia  iR(r)  -s  br"-  The  total  mass  suspended  at  time  t 
and  time  zero  respectively  is  given  by  the  numerator  and  denominator  of  (2). 

Following  the  assumptions  made  earlier,  the  recovery  fraction  is  a 
function  of  the  mean  (u),  the  variance  <r2  Qf  the  initial  particle  number 
distribution  and  the  chamber  constant  K.  Thus 


K(t)  =  R(t;  u,  ff,  K). 
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In  gaining  information  about  the  physical  recovery  curve  one  can, 
on  the  basis  of  aerosol  samples,  do  several  things.  Thus  you  can: 

(a)  Estimate  the  physical  recovery  fraction  at  time  t, 

(b)  Estimate  characteristics  of  the  particle  number  distribution 
such  as  the  mean  and  the  variance  of  Y  =  in  r.  At  time  zero,  y  would  be 
a  normally  distributed  Variable. 

Estimates  of  R{t|  u,  tr,  K),  E(y|u,  cr ,  K,  t )  and  Var(y|u,  cr,  K,  t) 
can  be  obtained  from  the  data  of  aerosol  samples,  where  u  and  cr  are 
parameters  of  the  log  normal  distribution  at  time  zero.  Knowing  these 
three  quantities,  it  would  be  desirable  to  know  u,  tr,  and  K,  This  would 
provide  a  basis  for  checking  the  validity  of  the  theory  concerning  K  and 
the  log  normal,  exp  (Kr2t)  system  in  general. 

Our  work  has  led  to  several  equations  that  should  be  useful  in  this 
connection.  As  mentioned  earlier,  y  was  defined  as  y  «=  ,£n  r.  The  vari¬ 
ables  v  and  q  will  now  be  defined  as 

v  =  (l/cr)(y  -  u) 

and 

(3)  q  »  -(l/Z)  Jin  Kt  -  u. 


Using  these  definitions,  the  physical  recovery  fraction  at  time  t  can  be 
written  as 

.  R(t  |  u,  cr,  K)  =  R(q,  cr)  . 

where 

(4)  R{q,  cr)  -(l/V^?)  F* exp  j-(l/2)  v2  -  e"2(q'3<r  '  “  w>]  dv 

Thus  initially,  the  tabulation  of  R  would  have  required  the  four  quanti¬ 
ties  t,  u,  it,  and  K  to  be  taken  irito  account.  The  q  formula  relates  t, 
K  and  u  and  thus  tabulation  becomes  simpler  in  that  R  needs  to  be  com¬ 
puted  only  as  a  function  of  q  and  cr.  One  of  the  slides  a  little  later  will 
show  the  relationships  among  R,  q,  and  cr2,  An,  approximation  formula 
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has  also  been  developed  for  computing  q  as  a  function  of  the  physical 
recovery  percentage  and  ir2  .  This  formula  is  useful  in  generating  a 
starting  value  of  q  for  iteration  procedures  for  the  solution  of  q  given 
R  and  <r.  The  approximation  formula  is 


(3)  q=  -(1/2)  £n  (~XnR)  +  |a  + 


B 


■in  (l 


where  A  and  B  are  appropriate  constants. 

Z 

Using  this  formula  suppose  q  is  calculated  given  R  and  a  .  If 
the  approximation  q  is  now  used  to  calculate  R  using  equation  (3),  the 
calculated  R  will  not  differ  from  the  original  R  by  more  than  0.02  for 
the  range  of  <r  values  pertinent  to  the  present  investigation. 


Some  additional  equations  are  listed  below. 


(6) 

(?) 

■(B) 


£(y  u,  r,  K,  t)  «  u  +  <r£(v 


q.  o') 


Var(y 


u,  oy  K,  t)  ■  9  Var  (v  q,  or) 


R(t,  u,  t,  K)  -  R(q,<r) 


where  the  frequency  density  of  v  is 


(l/fto)  exp  [-(1/2)  v2  -  e‘2(-q~  Vff)1  dv 

t  )  ^  exp  [-(1/2)  v2  *>  c-2^  "  V<rH  dv 
00  J 


Let  us  look  at  equations  (7)  and  (8).  These  are  two  simultaneous  equation 
Having  estimates  of  Var  y  and  R(t)  available  at  time  t,  one  can  solve  for 
estimates  of  q  and  <r.  Estimates  of  q  and  tr  make  possible  an  estimate  of 
<rE(v  |  q,  or).  This  latter  estimate,  when  coupled  with  an  estimate  of 
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E(y  |  u,  <r,  K,  t),  makes  possible  an  estimate  oi  u.  Equation  (3)  can 
be  solved  for  the  chamber  constant  K,  This  constant  is  a  function  of 
q  and  u,  Since  estimates  of  q  and  u  arc  available,  it  is  now  possible 
to  estimate  K.  Thus  from  estimates  of  q  and  u  are  available,  it  is  now 
possible  to  estimate  K.  Thus,  from  estimates  pf  R,  E^  and  Var  y  at 

time  t,  one  can  determine  U,  <r,  and  K, 

The  relationships  among  these  quantities  can  best  be  pointed  up  by 
means  of  graphs.  For  the  graphs  to  be  meaningful,  it  is  necessary  to 
make  appropriate  choices  for  the  parameters  u  and  a  o  the  log  normal 
distribution  of  particle  sizes  at  time  zero.  ;j  For  u,  the  range  from  O.  5 
to  5  fx.  seems  appropriate  in  the  subject  matter  area  to  which  this  in¬ 
vestigation  is  related,  Similarly,  an  upper  bound  for  cr  appears  to  be  In 
the  neighborhood  of  1.  5.  To  arrive  at  this  latter  number  we  define  two 
radii  ^  and  r2  such  that  50  and  84,13  per  cent  of  the  particles  at  time 

zero  have  radii  leas  than  r^  and  t^,  respectively.  Under  these  aasump-' 

tiona, 

in  r2  <*  u  +  cr 


and 

Hence 


/n  ri  a  “ 

it  =  An  (v2/rl) 


and 


When  cr  is  1.5,  the  ratio  of  the  two  radii  is  4,4817.  Thus  the  radius 
associated  with  the  84,13  per  cent  point  is  4.48  times  the  radius  for 


Cunt  point  whoa  cr  — 


^ o  bu  uc  a  re«« 


sonable  upper  bound  for  the  subject  matter  under  investigation.  In  de¬ 
veloping  table r,  the  values  of  o‘  shown  below  were  used. 
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c 

r2/rl 

0,4054? 

1.0 

O. 69315 

2.0 

1 .09861 

3.0 

1. 38629 

4.0 

Figures  1,  2,  3,  and  4  [figures  are  at  the  end  of  this  article])  illus¬ 
trate  various  parameter  relationships,  Figure  1  shows  the  relationships 
among  the  physical  recovery  fraction,  q  and >2  ,  Each  line  is  associated 
with  a  different  physical. recovery  fraction.  These  lines  are  almost  but 
not  quite  straight;  the  curvature  is  most  pronounced  in  the  lines  asso¬ 
ciated  with  the  lower  physical  recoveries. 

Figure  2  shows  the  relationships  between  q,  R,  and  Var  y,  each  line 
being  associated  with  a  different  physical  recovery  fraction.  Again  these 
lines  are  almost  straight;  the  greatest  curvature  being  associated  with 
the  lowest  physical  recovery  fractions. 

The  third  figure  shows  the  relationships  among  (l/Var  v),  Var  y  and 
R.  This  graph  can  be  used  to  estimate  qrz  from  estimates  of  R  and  Var  y. 
The  estimate  of  <r*  is  the  product  of  the  estimates  of  Var  y  and '(1/ Var  v). 
Thus  suppose  R  at  time  t  is  estimated  as  50  per  cent  and  Var  y  is  esti¬ 
mated  as  0.43.  The  value  of  (l/Var  v)  le  then  estimated  as  1,12.  The 
estimate  of  is  then  (O,  43)  x  (l.  12)  =  O,  48. 

The  final  figure  shows  relationships  amang  ( »<r  Ev),  R  and  the  standard 
deviation  of  y.  The  estimate  of  u  is  found  by  adding  (-  tr  Ev)  to  the  estimate 
of  Ey,  Again  suppose  R  =  O.  50  and  crz  a  O.  43.  In  this  case  vr y  ■  O.  66  and 

the  estimate  of  (-?  Ev)  is  0.065^-  .  Thus  the  estimate  of  u  is  found  by 
adding  0,065  to  the  estimate  of  u^. 

Hopefully,  the  relationships  which  have  been  developed  will  lead  to 


(1)  Quick  and  efficient  estimation  procedures  for  the  parameters 
which  characterize  physical  decay  in  aerosol  chamber  tHalB, 

(2)  Aids  useful  in  designing  and  interpreting  chamber  experiments 


(3)  Procedures  for  testing  the  validity  of  the  common  assumptions 


with  r c  spc % 


4-~  — 

w  £rat j  ei\,su 


dec »y , 


sail  vi 
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(4)  Ways  of  evaluating  the  bias  in  methods  of  estimating  biological 
recovery  percentages  which  employ  mass  tracer  data. 

Finally  and  most  important  of  all,  these  relationships  constitute  a  start 
toward  developing  methods  for  testing  the  validity  of  the  heterogeneous 
initial  recovery  model  for  biological  recovery. 


1.8 


o!  4  ole  i.'a 

Values  of  Var  y 

Figure  2.  Values  of  q  versus  Var  y  at  various 
physical  recovery  fractions. 


Value*  of  o 

Figure  3.  Value*  of  (1/Var  v)  versuB  oy  at 

various  physical  recovery  fraotion* 


Values  of  oy 

Flgut'e  4,  FIoLh  of  j-OEv)  versus  C’y  at  various 
physical  recovery  fractions. 


THE  ROLE  OF  INTUITION  IN  THE  SCIENTIFIC  METHOD 


Nicholas  M.  Smith 
Research  Analysis  Corporation 


ATSTRACT,  By  virtue  of  Huygens'  careful  appraisal  of  the 
Newtonian  metnod  of  inquiry,  a  logical  fallacy  has  long  been 
detectable  in  Newton’s  contention  that  he  had  deduced  truth  from 


observations  of  nature.  The  logical  fallacy  is  concerned  with 
two  aspects  over  which  empiricism  has  no  control)  (1)  the 
observation  that  what  constitutes  a  fact  in  the  test  of  a  theory 
is  not  determined  by  empirical  principles  alone,  and  (2)  the 
observation  that  the  constructs  of  science  cannot  be  demonstrated 
to  be  other  than  sufficient  with  respect  to  the  so-called  faats. 

The  naaessity--that  is,  the  uniqueness--of  these  constructs  aan 
never  be  established.  The  realization  has  gradually  emerged  that 
whatever’  "true,"  "valid,"  or  "warrantable,"  is  not  tc  bs  deter= 
mined  by  absolutely  singular  discoveries  produced  in  flashes  of 
insight,  but  by  selection  among  alternative  creative  insights  on 
the  basis  of  systematic  tests  constituting  the  reasoning  process. 

The  possibility  of  alternative  insights  of  equal  pradiotive 
applicability  makes  neoassary  the  imposition  of  some  principles 
othqr  than  empirical  ones  to  decide  among  them.  These  principles 
are  intuitive  and  categorical,  That  is,  there  exists  a  set  of 
cognitive  oontrols  (of  which  empirical  tests  are  members)  which 
are  established  for  the  sola  purpose  of  preventing  ambiguity. 

Some  of  these  principles  have  appeared  in  modern  and  contemporary 
science,  notably  the  principle  of  relativistic  invariainca,  which 
aan  be  traaad  directly  to  the  need  of  preventing  procedural 
ambiguity  introduced  by  transformations.  There  are  other  important 
introspective  controls  which  delimit  forms  acceptable  for  appli¬ 
cation  in  the  cognitive  act.  Many  of  these  introspective  principles 
are  to  be  found  separately  in  contemporary  theories  of  value,  We 


have  formulated  a  theory  of  these  cognitive  controls  based  on  our 
attempts  during  the  past  two  years  to  establish  the  foundations  of 
a  rational  methodology  for  systematic  and  organized  prescriptive 
activities,  that  is.  the  decision  process  in  all  its  generality, 
Science,  as  a  decision  system  whiah  has  as  its  purpose  the  pro¬ 
duction  of  predictive  theories,  is  shown  to  be  a  reduction  of  the,, 
more  general  axiologies.  Consequently,  many  of  the  important  so- 
called  laws  of  science  are  not  singular  discoveries  of  properties 
of  the  external  world  en tlrely ,  uuL  ax*e  xn  auuxlxun  nauassary  pro¬ 
perties  of  admissible  forms  which  may  serve  as  objectifioatlons  for 
applicable  symbolic  scientific  models,  Among  these  principles  may 
be  some  of  the  most  cherished  scientific  discoveries)  the  relati¬ 


vistic  properties  of  space-time,  the  conservation  of  momentum,  the 
conservation  of  energy,  the  second  law  of  thermodynamics,  and  the 
Heisingberg  uncertainty  principle. 
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INTRODUCTION ,  The  purpose  of  this  discussion  is  to  present 
the  findings" of ' a  study*  conducted  at  the  Research  Analysis 
Corporation  for  the  past  several  years  concerning  the  nature  of 
the  rational  or  cognitive  process;  This  study  has  revealed  that 
intuition  (or  introspection,  as  we  shall  call  it)  plays  a  much 
greater  role  in  the  process  of  rational  thinking  than  we  had  here¬ 
tofore  suspected.  The  nature  and  complexity  of  the  subject  is 
such  that  a  detailed  presentation  in  a  systematic  and  convincing 
step-by-step  procedure  would  require  many  hours,  We  Shall  there¬ 
fore  resort  to  a  presentation  of  our  material  in  the  time  available 
in  the  form  of  an  elaborate  abstract.  It  cannot  be  hoped  that 
such  a  shortened  version  of  our  presentation  can  be  wholly  con¬ 
vincing#  It  is  hoped,  however,  that  the  attention  of  the  reader 
will  have  been  directed  to  some  shortcomings  lh  prevalent  notions 
of  the  scientific  method  as  applied  to  the  design  of  experiments, 

Wg  also  hope  that  our  method  of  resolving  these  problems  will 
seem  plausible  and  that  your  own  interest  in  this  axoitlng  field 
will  be  aroused. 

The  study  I  am  describing  has  been  motivated  by  a  search  for 
the  foundations  of  management  science.  In  the  term  "management 
science"  I  mean  to  include  such  other  terms  as  operations  rasearoh, 
operations  analysis,  industrial  engineering,  economics,  and  the 
like.  Those  who  practice  thete  professions  are  not  in  complete 
agreement  as  to  a  statement  of  their  mission i  but  in  general  these 
ingredients  will  be  found  in  any  definition!  management  science 
i.B  somehow  to  provide  a  client  with  aide-quantitative  or  otherwise— 
to  ^ne  of  his  decision  processes,  Or,  the  analyst  may  even  go  so 
iar  as  to  recommend  specific  decisions  to  the  client,  These  aids, 

,/(v  these  recommendations,  are  formulated  with  respect  to  the 
i  client's  value  syBtemj  it  is  further  claimed,  either  implicitly 
for  explicitly,  that  the  management  scientist  employs  a  method 
which  will  somehow  lead  to  batter  decisions,  These  definitions 
!are  charged  with  highly  significant  but  poorly  defined  words.  These 
words  are  "decision, "  "values,"  "method"  and  "batter,"  The 
aearoh  for  an  understanding  of  the  ideas  behind  these  words  has 
triggered  an  escalade  of  theoretical  projects. 

In  the  first  place  we  have  committed  our  interest  to  the  field 
of  practical  decisions  and  therefore  have  become  interested  in 
the  theory  of  decision  algorithms.  To  many  por»un»  who  pracxice 
our  profession  this  subject  may  appear  ae  the  sole  content  of 
management  science,  ThiB  general  field  covers  such  divisions  as 
mathematical  programming,  queueing  theory,  logistics  theory,  game 
theory,  etc,  The  central  commodity  in  terms  of  which  decision 


A 'TKis  paper  describes  work  done  under  RAC  Study  554,  "Valuation 
and  the  Cognitive  Process."  hy  N,  M,  Smith  and  M,  C.  Marne y , 
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makers  operate  in  reaching  their  decisions,  however,  is  value.  3 

Since  values  are  the  determinants  of  decisions,  a  whole  new  | 

theoretical  field  in  the  theory  of  value  is  developing.  Value  | 

theory,  oh  the  other  hand  has  drawn  attention  to  the  decision  1 

process  in  context  of  system.  One  cannot  understand  the  act  of  | 

evaluation  without  understanding  the  nature  of  the  system  in  I 

which  Che  evaluation  procass  is  undertaken.  ■  This  situation  thus  1 

leads  to  a  third  theoretical  preject--the  theory  of  selective  | 

systems,  g 

Finally  one  must  turn  to  the  question  of  the  validation  or  I 

warranting  of  values,  policies,  and  ethical  systems.  The  question  f 

of  such  warrant,  together  with  questions  concerning  the  adequacy  1 

of  the  methodology  of  professional  management  scientists,  have  J 

drawn  out  interest  into  the  general  theory  of  cognitive  processes.  f 

RECONSTRUCTION  OF  PHILOSOPHICAL  FOUNDATIONS,  The  first  I 

impediment  one  encounters  in  the  search  For  a  method  of  warranting  f 

a  value-decisions  process  (or,  as  we  shall  call  it,  a  prescriptive  f 

process)  is  the  conoulsion  that  contemporary  scientific  method  is  | 

inadequate,  This  inadequacy  arises  because  one  of  the  ohlef 
adntrols  in  the  scientific  method  is  a  predictive  process.  One 
attempts  to  test  or  "warrant"  a  scientific  theory  by  means  of 
predicting  future  observations,  A  comparison  of  actual  observations, 
with  a  sultabls  definition  and  range  of  measurement,  will  then 
define  a  warrant  for  a  scientific  theory.  In  the  prescriptive 
process,  on  the  other  hand,  one  cannot  confirm  the  adequaay  of  a 
value  or  policy  by  predicting  one’s  own  decisions,  since  these 
values  are  the  indices  which  determine  these  decisions,  Such  a  f 

test  would  merely  demonstrate  a  degree  of  consistency  with  respect  j 

to  policy,  We  have  gradually  become  aware  that  the  prescriptive 
process  is  somehow  different  from  the  predictive  proaees,  In  sub¬ 
sequent  developments  of  the  theory  we  have  found  that  the  differences 
and  similarities  between  prescription  and  prediction  are  fairly 
complex,  as  I  shall  attempt  to  demonstrate,  j 

Failing  to  find  a  rational  prototype  for  the  validation  of  pre¬ 
scriptive  processes,  we  turned  to  a  survey  of  historical  and  con¬ 
temporary  ethical  and  value  theories,  Although  we  found  literally 
Hnr.en*  of  phi  1  nenphi  n«  1  schools  which  purported  to  brovlde  a  means 
of  selection  and  control  of  ethical  systems,  all  of '  them  exhibited 
inadequacies  of  various  kinds.  Failures  of  these  systems  and  the 
historical  failures  of  older  ethical  systems  and  scientific  methods  i 
have  occurred  in  a  characteristic  pattern:  ultimately  they  have  ■ 

been  confronted  with  situations  which  could  not  be  resolved  by  the  | 

principles  espoused,  1 
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It  may  also  be  observed  that,  to  a  large  degree,  it  has 
been  supposed  that  three  great  rational  methodologies  are 
treated  as  if  they  were  separate  processes,,  I  am  referring  to 
(1)  axiomatics,  a  selective  system  that  produces  valid  formal 
systems,  (2)  scientific  method,  a  selective  system  that  produces 
predictive  theories,  and  (3)  axiological  method,  a  method  that 
produces  prescriptives ,  policies,  ethics,,  It  has  been  assumed 
that  axiomatics  may  be  adequately  controlled  entirely  by  the 
rules  of  logic.  On  the  other  hand,  the  history  of  the  scientific 
method  has  bean  characterized  by  the  accretion  of  both  logical 
and  empirical  controls  and,  in  modern  science  to  some  degree,  by 
the  injection  of  intuitional  controls,,  The  axiologias  have  been 
presumed  to  have  been  controlled  entirely  by  intuition,  There 
have  been,  of  course,  attempts  to  approach  ethics  and  values 
from  a  naturalistic  viewpoint  as  predictive  entities,  but  these 
studies  can  be  shown  to  be  concerned  with  value  systems  as 
objects,  wherein  our  chief  concern  has  been  with  value  systems 
as  subjects,  (That  is,  what  should  my  policy  and  my  values  be 
in  order  to  determine  my  decisions?) 

Having  failed,  then,  to  fine  a  rational  prototype  for  the 
warranting  of  the  prescriptive  process,  we  have  been  forced  to 
attempt  a  reconstruction  in  the  philosophical  foundations  of 
the  rational  method  in  order  to  incorporate  axiologias  into  the 
group  of  systematic  rational  pursuits,  This  reconstruction  has 
taken  the  nature  of  a  synthesis  among  modern  scientific  method* 
and  contemporary  and  historic  value  and  ethical  theories.  It 
promises,  besides  its  direct  application  to  axiology,  to  yield 
additional  enlightenment  on  axiomatics  (that  ip,  the  aontrol  of 
mathematical  method)  and  the  scientific  method,  This  intimation 
is  pertinent  to  the  objectives  of  this  conference  and  represents 
the  specific  subject  of  my  discussion, 


THE  DEVELOPMENT  OF  A  METATHEORY,  It  is  desirable  to  distin- 
quish“Ee?we9n  me tathebry  ~ancf  "ofijec t- theory ,  An  objeot-theory  is 
a  theory  which  objectifies,  or  externalizes,  objects.  Such 
theories _ create  the  following  types  of  objects j  the  objects  of 
mathematics  and  logic  are  sets  of  se.l f -consistent  formal  state¬ 
ments  together  with  their  consequent  theorems;  the  objects  of 
science  are  particular  predictive  theories  and  the  elements 
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ui  ttAiuiujjxea  are  particular  policies 
that  determine  or  prescribe  practical  decision,  A  metatheory, 
on  the  other  hand,  is  a  theory  about  object-theories.  In 
particular  it  is  a  theory  about  the  methods  of  admission  or  con¬ 
trol  and  warrant  of  object  theories,  Our  theory  is  a  meta- 
theory  in  which  we  are  attempting  to  synthesize  the  metatheories 
of  mathematics,  science  and  axiology  under  one  conformal  per- 
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Any  such  theory  presupposes,  explicitly  or  implicitly,  certain 
ontological  and  epistemological  commitments,  i,e,,  commitments 
as  to  what  constitutes  existence  and  knowledge  respectively. 

Central  among  our  commitments  is  the  notion  of  relativism  in 
three  facets!  the  first  is  onotological  relativism.  This  refers 
to  the  doctrine  that  existence  of  an  object-construct  is  deter¬ 
mined  by  its  testability  in  principle  or  its  connectability  by 
inference  to  other  object-constructs  which  are  testable  in 
principle,  In  other  words,  one  rejects  the  notion  of  things-in- 
themselves  or  concepts  which,  by  their  very  nature,  are  not 
subject  to  test,  The  term  "test,"  of  course,  refers  not  only  to 
empirical  tests  but  to  intuitive  and  formal  tests  as  well. 

The  second  facet  is  relativism  in  epistemology.  This  refers 
to  the  doctrine  that  certainty  of  knowledge  of  object-oonstructs , 
i,e#,  the  establishment  of  apodictio  truth  (truth  by  necessity) 
is  not  obtainable,  One  must  observe  that  the  proofs  of  validity 
or  warrantability  of  any  scientific  theory  merely  determine  the 
efficiency  of  that  theory  in  coordinating  and  clarifying  the 
Information  obtained  under  a  consistent  predictive  format,  There 
is  never  any  certainty  that  some  other  theory  may  not  be  dcvalonad 
whiah  would  describe  the  observations  equally  well  or  better*  nor 
is  there  any  certainty  that  the  presently  accepted  theory  will  be 
adequate  with  respect  to  any  future  information  that  may  be  obtain¬ 
ed,  The  consequence  of  these  observations  is  that  absoluteness 
at  the  objeot  level  is  not  meaningful, 

A  third  faaat  is  perspective  relativism.  This  refers  to  the 
doctrine  that  an  absolute  reference  for  the  judgment  of  objeot- 
theories  is  not  obtainable*  As  we  shall  sea  in  a  moment,  the 
consequence  of  this  commitment  is  Einstein's  principle  or  invar¬ 
iant  transformations, 

A  second  commitment  presupposed  by  our  mats  -theory  is  that 
the  sole  function  of  the  metacognitive  process  is  the  assurance 
of  decidability  of  ob ject-statements--that  is,  decidability  with 
respect  to  their  admissibility,  The  aoncept  here  is  that 
relativism  in  object-space  leads  to  degrees  of  freedom,  .Decision 
as  to  which  object-constructs  in  this  range  of  freedom  are  to  be 
admitted  muBt  be  accomplished  in  terms  of  some  metaprinciple  or 
control,  This  control  then  becomes  a  new  absolute  replacing  the 
aDsoiutes  relinquished  at  the  object  level,  That  is,  the  control j 
are  categorical,  and  they  are  metacontrols,  The  consequence  is 
the  conclusion  that  ambiguity  is  the  sole  motivation  for  decision. 


■'S 


THEORY  OF  COGNITIVE  CONTROLS.  There  are,  however,  many 
kinds  of  ambiguities  and  each  type  of  ambiguity  necessitates  a 
corresponding  control.  As  we  have  said  before,  these  controls 
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are  categorical  and  their  sole  function  is  to  resolve  ambiguities 
of  the  class  to  which  they  apply.  We  have  classified  the  controls 
in  terms  of  three  factors  which  we  call  formal,  extroapective , 
and  introspective.  Besides  these  reflexive  or  internal  controls 
there  are  also  sets  of  external  acntrols  which  wa  refer  to  as 
evolutionary  and  aesthetic.  One  of  the  great  difficulties  in 
developing  an  acceptable  metatheory  is  collection  of  provision 
for  selection  among  alternative  object- clioorioa  which  purport  to 
apply  to  the  same  problematic  situations.  This  selection  is 
accomplished  by  means  of  evolutionary  control--a  generalization 
of  the  Darwinian  principle— and  aesthetic  control  (elegance). 

The  evolutionary  controls  (fruitfulness,  adaptability,  and 
survival)  represent  ultimate  commitments.  Sinae  the  general 
thesis  of  this  presentation  can  be  developed  without  an  elabora¬ 
tion  of  these  important  concepts,  and  since  time  does  not  permit 
such  an  elaboration,  we  shall  forego  any  further  discussion  on 
these  topics. 

Central  to  our  theory  is  the  aoncept  "objeatifiaation," 
Objectification  represents  the  emergent  result  of  a  creative  act 
which  externalizes,  at  the  level  of  a  cognitive  agent  or  self,  a 
Bet  of  new  conceptual  entities  or  objeot-construats  on  a  trial 
basis  as  an  act  of  policy  and  subject  to  a  warrant  to  be  establish¬ 
ed  for  predictive  or  orescriptive  purposes  by  a  set  of  cognitive 
controls.  In  this  viewpoint  all  rational  prooass  is  undertaken 
in  terms  of  object-oonstruots ,  a  special  class  of  object-constructs 
being  theories  or  models. 

The  formal  controls  of  an  object-construct  apply  to  its 
format  or  formal  properties.  They  insure  admissibility  under 
testB  of  consistence,  completeness  and  independence, 

Extroapective  Controls,  There  are  two  acts  in  the  extrospective 
control.  1  fine  is  the  determination  6f  the  Criteria  of  fact— that 
is,  the  selection  of  the  specification  of  what  constitutes  a 
relevant  fact  based  on  a  formal  objectification  selected  among 
an  indefinite  set  of  objectifications  as  an  act  of  policy.  The 
criteria  of  fact  becomes  a  filter  through  which  extrospection  is 
admitted  as  relevant  to  the  problematic  situation  at  hiind,  Thus, 
in  the  act  of  its  admission,  any  "fact"  has  formal,  introspective 
and  extrospective  components.  There  is  no  such  thing  as  a  purely 
extrospective  fact.  This  supports  the  views  of  contemporary 
philosophers  of  science.  So  let  me  repeat?  this  conference, 
concerned  as  it  is  with  the  design  of  experiment,  or  as  I  have 
called  it,  the  criteria  of  fact,  is  concerned  with  much  more  than 
extrospective  information  or  data.  In  particular,  it  is  concerned 
with  formal  and  introspective  (that  is,  intuitive)  properties. 

Now  "extrospection"  means  a  looking  outwards,  or  receptivity  to 
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information  processed  through  transducers  and  subsystems  whose 
outputs  are  presented  to  mediation  at  conscious  level.  On  the 
basis  of  the  objectifiaation  or  model  one  undertakes  a  prediction, 
that  is,  a  symbolic  projection  forward  in  time  beginning  with  an 
extrespeeiively  determined  initial  state  and  in  terms  of  a 
specific  objectification.  This  leads  to  an  expectation,  A 
significant  discrepancy  at  a  later  time  between  expectation  and 
extrospeotion  engenders  extrospeetive  ambiguity.  In  order  to 
define  extrospeetive  ambiguity,  one  must  first  select  (a)  a  range 
of  initial  admissible  expectations,  (b>  a  range  of  admissible 
divergencies  between  expectation  and  extrospeotion  at  a  later 
time,  and  (c)  a  frequency  measure.  We  oan  now  define  extro- 
spective  ambiguity  as  follows j  a  set  of  final  expectations  and 
extroapectiona  are  empirically  nonambiguoua  if,  and  only  if,  a 
set  of  histories  all  beginning  with  initial  states  in  the  admissible 
range  are  examined  apri  ara  found  to  contain  a  subset  0?  final 
states  lying  in  the  admissible  range  around  expectation,  such 
that  the  ratio  of  the  number  of  final  admissible  histories  to  the 
number  of  initial  admissible  histories  is  equal  to  or  greater 
than  the  frequency  measure. 

The  decisions  as  to  the  admissible  initial  and  final  ranges 
and  the  frequency  measures  are  determined  by  the  problematic 
situations  which  are  desired  to  be  resolved  by  the  objectifiaation. 
This  range  of  application  represents  an  aesthetic  decision.  One 
could,  for  example  (sas  Table  1),  set  the  frequency  measure  equal 
to  zero,  in  which  oast  he  is  Maying  he  is  indifferent  to  the 
correspondence  between  expectation  and  axtroapaction.  He  then 
becomes,  by  this  aesthetic  orientation,  primarily  concerned  with 
the  formal  properties  of  his  objaotifioation.  That  is,  he  becomes 
a  mathematician,  Ha  maintains  an  interest  in  the  residual  sub¬ 
stantive  properties  of  his  constructs  as  exhibited  by  his 
attention  to  the  nature  and  efficiency  of  his  notation. 

If  the  range  of  problematic  situations  desired  to  be  faced 
includes  prediction  of  situations,  then  the  frequency  measure  is 
set  at  a  non-zero  value.  We  shall  call  such  a  person  a  soientist 

Jrovided  that  he  has  also  set  his  norms  with  respect  to  action 
mplied  by  his  ob jeatification  at  null  values,  such  that  he  is 
indifferent  to  such  aotion.  If  he  becomes  aesthetically  oriented 
completely  toward  action  with  respect  to  *11  «nrl 

problematic  situations,  he  will,  in  general,  find  that  he  has 
greater  difficulty  in  satisfying  all  of  the  cognitive  controls 
and  hence ,  facing  more  restrictive  constraints,  must  reduce  the 
scope  of  comprehensiveness  of  his  models,  A  primary  control  is 
that  of  practicability.  What  is  practicable  with  respect  to  an 
action  problem  may  be  oversimplified  with  respect  to  a  predictive 
problem.  What  is  practicable  to  a  scientist  may  be  impractical 
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Table  1 

A  UNIFIED  META -CONTROL  SYSTEM 


Metasystem 

Operation 

Range  o f 
problematic 
situations 

Aesthetic 

Decisions 

Scope  of 
objectifications 

practicable 

Axiology 

Ratrodiction 

All  practical 
problems 

All  norms 
effective 

Most  severely 
restrained, 
most  reduced 

Science 

Prediction 

Specific  predic¬ 
tive  situations 

Action  norms 

St 

indifference 

Restrictions 
moderate,  richer 
range  of  ob¬ 
jectifications 

Axiomatic  S 

Formal  ex¬ 
tension 

Consistent 

axiomatic 

systems 

Action  norms 
at  indifference, 
extro  spectlve 
ambiguity 

Least  restricted, 
richest  in  for¬ 
mal  content 

measure  at 
null 
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to  a  man  of  action,  etc,,  the  objeetif icationa  becoming 
correspondingly  richer  as  one  goes  from  axiology,  to  science, 
to  mathematics,  as  the  cognitive  controls  become,  in  soma  sense, 
degenerate. 

There  is  also  a  very  important  difference  between  the  view¬ 
point  of  prescription  and  the  viewpoint  of  prediction--that  is, 
tha  prescriptive  operation,  although  it  may  warrant  its  objecti¬ 
fication  or  modal  prediotively *  whan  it  is  used  in  prescription 
it  is  turned  around  and  used  retrodictively .  Now,  retrodiation 
is  net  the  exact  reverse  of  the"" predictive  process ,  It  is  this 
difference  between  retrodiction  and  prediction  which  makes  aeienae 
and  axiology  aaquira  complementary  oharaoteristios.  One  ia  said 
to  be  adjoint  to  the  other. 

This  property  has  very  important  philosophical  as  well  as 
methodological  implications.  In  particular,  ths  primal  or 
pradiotiva  viewpoint  represents  the  view  of  a  oonstruot  as  an 
object  whereas  the  complementary  or  dual  can  be  interpreted  ae 
a  representation  of  the  oonstruot  as  a  subjsot.  Thus,  in  terms 
of  value  theory,  predictive  value  theory  Is  a  systam  by  maafts 
of  which  one  observes  the  decisions  of  another  person  as  date 
and  makes  a  theory  ths  value  system  of  that  parson  as  an  object, 

On  tha  prescriptive  side  of  value  theory,  one  ia  concerned  with 
one’s  own  values  as  determinants  of  one's  own  decisions.  It  is 
this  prooeas  that  is  rstrodiotivs. 

Introspective  Controls.  Tims  will  not  permit  a  detailed 
disoueaion  of  introspective  controls.  We  shall  endeavor,  how¬ 
ever,  to  say  enough  about  these  so  that  their  function  and 
importance  can  be  realized.  Let  us  look  at  perspective  .control, 
This  ia  the  direct  application  of  our  epistemological  commitment 
to  perspective  relativism.  One  may  refer  a  statement  in  an 
objectification  to  a  particular  context  of  coordinate  system*. 
Ultimately,  they  may  be  transformed  into  another  and  a  description 
mads  in  terms  of  another  ooordinats  system.  If  this  transformation 
depends  upon  the  procedure  or  path  taken  from  one  system  to 
another,  one  would  naturally  get  a  different  result  from  the 
transformation  depending  upon  the  path  taken.  This  would  result 
in  what  we  may  call  perspective  ambiguity.  If  there  existed 
an  absolute  point  of  reference,  then  a  natural  algorithm  for 
transformations  would  be  indioated.  One  would  simply  transform 
from  the  first  coordinate  system  to  the  absolute  origin  and 
from  there-  to  the  new  coordinate  system.  In  ths  abgenes  of  any 
such  absolute  perspective,  one  must  limit  the  transformations  to 
those  having  a  particular  property. 

We  seek  a  class  of  transformations  which  do  not  lead  to 

ambiguity,  regardless  of  the  procedure  or  path  taken.  These  are 
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called  invariant  transformations  and  they  result  in  a  formal 
description  in  the  new  coordinate  system  which  is  identical 
to  the  formal  description  in  the  old  coordinate  system.  This 
is  tha  principle  of  invariance.  While  it  has  a  rather  abstract 
title,  and  while  the  discovery  of  invariant  transformations 
may  sometimes  be  difficult,  the  intent  and  meaning  of  the  princi¬ 
ple  is  very  simple,  It  says  merely  that  one  must  avoid  procedural 
iy  induced  ambiguities. 

In  a  space-*, ■'.me  transformation  of  a  physical  theory,  this 
loads  directly  to  the  Lorentz-Einstein  conditions  for  a  space¬ 
time  transformation.  Now  it  is  also  true  and  also  of  interest 
that  if  one  looks  at  an  object-space  determined  by  a  Markov 
stochastic  system  and  asks  for  a  nonatobiguous  or  invariant  trans¬ 
formation  of  a  velocity  in  a  Markov  space  (i,e,,  the  velocity  of 
movement  of  a  probability  configuration),  half  of  the  conditions 
for  an  invariant  transformation  emerge  as  a  result.  The  adoption 
of  the  second  half,  as  necessary  for  an  invariant  transformation, 
is  equivalent  to  the  introduction  of  tha  set  of  imaginary 
probabilities  whioh,  together  with  the  real  Markov  probabilities, 
are  to  ba  associated  with  each  transition.  The  results*,  whioh 
may  not  surprise  you  by  now,  are  none  other  than,  again,  the 
Lorentz-Einatein  transformation  equations  in  the  space  defined  by 
tha  Markovian  system. 

Before  the  time  of  Einstein,  soienoe  and  axiology  were 
presumed  to  ba  entirely  separate,  soienoe  being  the  province  of 
empiricism  and  formal  logic,  whereas  axiology,  separate  and  dis¬ 
connected,  was  the  province  of  intuition.  Then  Einstein  shook  the 
vary  foundations  of  physical  theory  by  a  brillant  and  euooessful 
modification  of  the  cherished  concepts  of  apace  and  time— a 
modification  which  depended  not  on  empirical  discovery  byt  upon 
application  of  an  intuitional  requirement. 

Even  today  the  commitment  to  empiricism  is  sufficiently 
strong,  and  naive  realism  is  so  Firmly  established,  that  the  full 
significance  of  Einstein's  principle  is  not  realized.  This 
principle  does  not  refer  to  a  singular  discovery  of  a  property  of 
the  external  world,  but  instead  to  a  necessary  property  of  admis¬ 
sible  forms  which  may  serve  as  objeatifications  for  applicable 
symbolizations.  We  are  constrained  to  think  in  terms  of  per- 
spectively  invariant  forms,  or  we* are  inevitably  led  to  ambiguity, 
Einstein,  having  achieved  a  nonambiguous  formulation  of  mechanics, 
wa3  then  able  to  proceed  to  show  a  relation  between  energy  and 
mass.  The  relation  between  energy  and  mass  is  not  a  substantive 
consequence  of  relativistic  invariance?  it  is  merely  a  formal 
result  educed  by  an  enlightened  procedure  whioh  was  made  possible 
by  a  form  of  nonambiguous  thinking, 

"amiin,  lucholas  M,  ,  "A  Calculus  for  Ethics;  A  Theory  of  the 
Structure  of  Value,"  Behavioral  Science,  Vol.  1„  Nos.  2,  3. 
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Other  Implications  of  Invariance «  Einstein's  invariance 
has  other  far-reaching  implication* ,  particularly  when  we 
generalize  the  principle  to  state  that  all  formal  objectifications 
must  be  invariance  with  respect  to  significant  transformations. 
"Significant"  transformations  are  these  in  wnion  the  ambiguity 
arising  from  noninvarlanoy  will  be  distinguishable  from  the 
range  of  admissibls  extrospeotive  error.  Generalized  invariance 
has  particular  importance  and  implication  in  value-decision 
theory.  One  demands  by  application  of  this  principle  that  the 
transformation  of  decision  from  a  present  to  a  future  state  by 
means  of  the  Chapman-Kolmogorov  transformation  shall  lead  to  a 
form  of  the  value-decision  equation  identical  with  the  initial 
one.  If  this  were  not  true,  then  the  deoiaion  indicated  by  the 
value-deoision  equation  would  depend  upon  the  prooedure  in  whioh 
a  decision  waa  staged  into  parts  for  analysis.  The  requirement 
of  invariance  with  respect  to  time-tranelation  trane format ion  is 
insured  first  by  the  nature  of  the  Chapmsn«Kolmogcrov  equation, 
and  second  by  the  placing  of  an  important  restriction  on  the 
decision  operator.  This  restriction  is  one  of  commutation. 

A  deoiaion  operator  which  commutes  through  the  stages  of  decision 
proaess  will  permit  an  invariant  transformation  of  ths  aquation  as 
applied  from  one  point  of  rafirenaa  in  time  to  another.  This 
property  is  also  known  by  another  name.  It  is  the  principle  of 
optimality  of  dynamic  programming.  The  latter  ia  connectable  to 
Euler 's  Weirstraese  and  Lagandra  conditions  of  steepest  desoent 
algorithms. 

It  may  also  ba  shown  that  the  Chapman-Kolmogorov  equation,  as 
It  enters  into  value  theory,  introduces  a  concept  analogous  to 
momentum  by  virtue  of  the  fact  that  the  value  aquation  it  analogous 
to  the  conservation  of  momentum.  Again  the  selection  of  a  model 
in  whioh  the  Chapman-Kolmogorov  aquation  applies  has  been  based 
upon  the  need  for  an  invariant  modal  as  a  starting  point  for  the 
building  of  a  theory.  It  also  may  lead,  one  adds,  to  a  suggested 
generalisation  or  modification  of  the  law  of  conservation  of 
momentum. 

. Other  Introapsotivs  Controls .  There  are  other  introspective 
controls,  each  m  its  way  fully  ae  important  as  the  principle  of 
invariance j  and  each,  whan  stripped  of  technical  verbiage,  merely 
assures  nonambiguity  and  therefore  decidability  in  the  object- 
model . 

One  of  these  controls  refers  to  the  context  of  an  objaet- 
construet.  It  require#  that  the  context  be  specified  in  order  to 
complete  the  meaning  of  the  construct  and  it  further  specifies 
that  an  object-construct  may  have  only  one  context,  Bince  if  it 
had  more  than  one  context,  it  would  be  ambiguous.  This  particular 
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control,  a  modification  of  the  Russell-Whitehead  -theory  of 
types,  can  be  expected  to  have  important  significance  in  the 
removal  of  certain  kinds  of  paradoxes  from  modern  logic. 

Another  introspective  control,  which  is  a  direct  statement 
of  onotological  relativity,  constrains , all  ob ject-oonstructa 
to  those  which  are  testable  in  principle.  A  third  control 
r c q v’  1 , r ™ g  furthermore  that  the  test  of  the  construct  must  not 
only  be  attainable  in  principle,  it  must  be  attainable  and 
interpretable  in  terms  of  finite  processes.  This  control 
will  rule  oirf  infinite  processes  and  continuous  time-space  as 
directly  applicable  to  substantive  constructs.  Such  concepts 
must  assume  a  secondary  status'— that  of  operating  constructs 
which  guide, the  interpretation  of  finite  extrospection  in  the 
context  of  a  particular  objectification.  Examples  of  such 
secondary  or  operating  construct^  ares  the  wave  functions  of 
wave  meonaniaa  (whioh  operate  away  in  the  aat  of  evaluating  a 
measurable  entity),  the  ooncapt  "true"  probability,  which  is 
never  attainable  *  the  optimum  in  a  decision  process,  whioh  is 
never  achievable \  also  inoluded  is  the  class  of  decision  variables 
as  contrasted  with  ths  class  of  object  variables. 

The  effect  of  introspective  controls  i*»  to  restrain  the 
•eleation  of  objeot-models  whioh  are  admissible  for  serving  as 
the  formal  content  of  objeat-construats.  It  therefore  should 
come  as  no  surprise  that  the  form  of  all  successful  theories 
(that,  is,  theories  whioh  prove  to  be  admissible  under  extrospective, 
introspective  and  formal  tests)  will  shown  strong  analogies. 

Nor  is  it  surprising  that  scientists  have  digeovered  intro¬ 
spective  principles  in  the  course  of  empirical  .investigations  and 
have  believed  them  to  be  part  of  the  extrospeative  aontent  of 
their  observations. 

This  is  not  to  say  that  these  explicit  principles,  when  they 
appear,  are  wholly  intuitive,  but  rather  that  they  are  the  con¬ 
sequents  of  intuitive  requirements,  A  successful  theory— no 
matter  in  what  terminology  it  is  formulated—will  contain  those 
principles  in  order  to  be  nonambiguous. 

Modern  mathematicians  have  rediscovered  Einstein's  principle 
of  invariance  recently  and  nave  given  it  a  name  implying  an  extro¬ 
spective  connotation— they  call  it  the  principle  of  causality,  and 
further,  go  so  far  as  to  say  that  it  is  the  basics  principle  of 
classical^physics , 
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These  sets  of  controls  alone  are  not  sufficient  to  determine 
decidability.  They  are  reflexive  controls  only.  Ultimate 
decidability  depends  also  on  evolutionary  controls,  aesthetic 
controls,  and  on  an  intuitively  established  and  evolutionary 
validated  set  of  norms.  Time  does  not  permit  discussion  of 
them  here.  Their  introduction  and  application  merely  serve  to 
support  the  statement  that  extrospeetion  is  only  a  part  of  a 
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and  desirable  part  of  the  rational  process,  must  be  imbedded 
for  its  understanding  in  the  context  of  the  motaayatem.  The 
nature  of  the  evolutionary  control  is  to  Insure  fruitfulness, 
adaptability  and  survival  of  a  concept  as  a  workable  construct . 
Formalizations  which  have  inherent  ambiguities  must  necessarily 
sooner  or  later  reach  a  condition  where  decidability  aannot  be 
established}  and  they  must  surely  fail.  This  does  not  imply 
that  once  a  method  of  rational  inquiry  is  devised  which 
accomplishes  decidability  it  aan  be  expected  to  retain  this 
property  indefinitely. 

Novelty  is  a  characteristic  of  emerging  eonaapts.  Novelty 
will  inevitably  occur  in  the  method  of  inquiry  itself.  The 
appearance  of  higher  orders  of  abstraction  will  make  necessary  a 
re-establishment  of  cognitive  control  evolving  through  a 
repetitive  cycle  of  ambiguity,  undeoidabi lity ,  and  finally  the 
discovery  of  new  rational  principles. 

CONCLUSION.  The  conclusion  I  wish  to  draw  from  these 
remarks  is  that  knowledge  depends  as  much  upon  intuition  as  it 
does  upon  extrospeetion  and  logic}  and  that  these  aspects  are 
intardspendant ,  I  have  hoped  to  make  you  aware  of  the 
implication  that  the  nature  of  iJ»a  rational  act  is  muah  more 
complicated  than  heretofore  supposed  and  that  the  simplistic 
vlaws  of  cognition  must  irrevocably  ba  discarded.  ; 
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HOW  TO  DESIGN  WAR  GAMES  TO  ANSWER  RESEARCH  QUESTIONS 


William  L>.  Pierce 
Research  Analysis  Corporation 


INTRODUCTION,  In  war  gaming,  to  produce  data  for  analysis,  the 
gams  itself  and  the  forms  of  data  extraction  must  be  designed  to  give 
outputs  conveniently  usable  in  answering  the  specific  research  questions 
that  the  game  seeks  to  solve.  This  paper  presents  methods  developed 
with  this  purpose  in  mind  and  employed  in  a  rigidly-assessed,  manually- 
played  war  game.  With  a  brief  historical  sketch  of  the  uses  of  war  gaming 
from  the  19th  century  to  the  present  as  background,  present  war  games 
are  classified  into  three  groups,  manual,  computer -assisted,  and 
computer -programmed,  and  defined,  The  design  of  manually -played  war 
games  Is  then  considered  separately  in  the  context  of  a  laboratory  re¬ 
search  tool.  Finally,  the  application  of  the  design  requirements  Is  illus¬ 
trated  by  a  description  of  TACSPKL,  RAC's  division  level  war  game. 

Historically,  war  games  have  been  developed  and  played  to  train 
officers  and  to  test  war  plans.  The  former  purpose  was  evident  in  the 
9th  century  when  Rigid  Kriegspiel  and  Free  Kriegsplel  were  developed. 

The  tasting  of  war  plans  by  war  games  was  used  extensively  by  the  Ger¬ 
mans  in  ths  first  half  of  the  20th  century.  After  World  War  11,  the 
technique  of  employing  war  games  as  an  analytic  tool  was  developed  In 
an  attempt  to  answer  military  questions  pertaining  to  the  battlefields  of 
the  future.  With  the  advent  of  high  speed  computers,  war  gamers  ac¬ 
quired  a  tool  that  permitted  more  comprehensive  and  complex  games  to 
be  played.  Also,  the  computer  brought  about  a  classification  of  war 
games  by  the  war  gaming  community.  A  straightforward  classification 
is  to  consider  war  games  as  either  manually-operated,  computer  assisted, 
or  computer  programmed, 

A  manually-operated  game  ie  one  in  which  all  game  orders  are 
written,  and  assessments  are  made  by  people  who  are  governed  by  strict 
or  informal  game  rules,  in  essence,  a  rule  book  or  an  umpire, 

A  computer-assisted  war  game  is  a  manually-operated  game  with  the 
additional  attribute  that  some  of  the  bookkeeping  and  assessments  are 
accomplished  by  a  computer, 
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The  third  classification,  the  computer  war  game,  is  rfow  in  a  pro¬ 
minent  position  in  the  war  gaming  field,  in  this  type  of  game,  after  the 
start  button  is  pushed.  the  computer  plays  the  game  without  human  inter¬ 
vention.  Each  and  every  situation  thought  to  be  important  must  be  antici¬ 
pated  and  simulated  in  the  program  with  a  suitable  response. 

THE  DESIGN  QF  A  WAR  GAME  AS  A  RESEARCH  TOOL,  Lei  us  now 
consider  a  war  game  &s  a  laboratory  tool  for  military  research.  While 
much  of  what  follows  applies  to  all  classifications  of  war  games,  1  will 
be  directing  my  words  toward  manual  war  games  as  a  prelude  to  the 
later  description  of  TACSPIEL. 

One  use  of  a  laboratory  tool  Is  to  enable  the  experimenter  to  Investi¬ 
gate  an  area  which  would  be  inaccessible  without  the  tool,  For  the  military, 
the  battle  field  of  the  future  is  the  area  at  which  attention  is  focused.  To 
open  this  area  for  investigation,  the  war  game  becomes  the  tool,  But  for 
the  experiments,  or  research  plays,  if  you  will,  to  be  meaningful,  the 
war  game  must  be  analytic,  That  is,  it  must  be  engineered  to  present 
a  realistic  environment  for  controlled  experimental  simulations  with  a 
view  toward  securing  data  for  analysis. 

It  Is  not  a  difficult  task  for  the  military  customer  and  the  designer 
of  war  games  to  agree  that  war  games  can  aid  in  the  solution  of  military 
problems.  However,  when  the  research  questions  are  directed  at  echelons 
from  platoon  to  army,  the  designer  must  step  back  and  take  a  sharp  look 
at  the  design  problems  both  obvious  and  subtle. 

What  does  he  see  in  the  way  pf  problems?  First,  there  is  the  resolu¬ 
tion  problem.  What  is  the  garnet  of  resolution  that  should  be  considered 
in  the  game?  Can  the  military  units  be  played  at  company  and  battery 
level?  Where  and  when  can  platoon,  patrols,  and  radars  be  introduced? 

Do  the  research  questions  permit  the  game  to  be  designed  with  divisions 
as  the  lowest  echelon?  To  what  resolution  shall  the  unit  deployments  be 
recorded  and  played?  How  often  should  the  game  interactions  be  assessed? 

The  second  problem  which  gn»H  bnnd-in-glnvp  with  thp  rppnlnHpn  pro¬ 
blem  is  the  aggregation  of  the  game  models.  If  the  basic  unit  is  the  com¬ 
pany,  then  the  models  must  reflect  the  capabilities  of  the  company  to 
move,  fight,  and  receive  casualties.  There  1b  a  paramount  requii  bill  6  ill 
here  when  the  designer  builds  the  game  models.  Once  he  has  chosen  the 
resolution  for  the  military  units ,  he  must  be  extremely  careful  to  avoid 
constructing  a  game  model  for  which  no  predictive  data  exists  at  the 
designed  echelon.  Should  the  input  data  to  the  model  be  lacking  for  the 


455 


Design  of  Experiments 

echelon  designed,  the  designer  must  re-examine  the  unit  resolution,  In 
short,  resolution  and  aggregation  as  reflected  in  the  game  models  are  the 
two  sidles  of  the  same  coin. 

Another  problem  which  relates  to  the  desired  analytic  nature  of  a 
manual  war  cram*  is  assessment  of  the  nlav.  A  same  can  be  Dlaved  under 

- -  «* - *  #  me  m  e 

a  set  of  general  rules  with  an  umpire  to  assess  battles,  contacts,  and 
other  interactions.  Or  the  game  can  be  played  under  a  set  of  rigid  rules 
which  are  as  detailed  as  the  designer  can  make  them.  In  this  case, 
umpiring  occurs  infrequently  and  only  when  eituatlone  and  capabilities 
arise  that  are  not  provided  for  in  the  rules.  This  latter  method  will  pro¬ 
duce  the  most  objective  and  well-defined  experimental  conditions  for  a 
manually  conducted  game  that  can  be  attained. 

Once  the  war  gamer  has  decided  on  the  resolution  and  aggregation 
level,  he  must  now  consider  the  basic  tactical  structure  of  the  game. 

There  are  three  characteristics  which  identify  combat.  They  are  the 
movement  of  units,  the  meeting  of  units  known  as  contact,  and  the  en¬ 
gagement  by  fire  and  maneuver  of  opposing  units  called  battle.  These 
characteristics  are  the  basic  tactical  structure  of  a  war  game  whether 
the  game  depicts  ground,  sea  or  air  warfare.  Any  war  game  design 
must  start  by  constructing  mddsls  to  represent  these  three  characteristics. 

Ones  the  basic  models  of  movement,  contact,  and  battle  exist,  the  war 
game  is  ready  to  consider  the  specific  research  questions  of  the  military 
customer,  When  the  research  question  is  asked,  the  war  gamer  must 
ask  himself  three  questions. 

What  models  must  be  built  such  that  the  events  to  which  the  question 
is  addressed  will  necessarily  occur  in  the  course  of  the  play?  What 
additional  models  must  be  designed  to  reflect  the  player's  usual  military 
capabilities,  for  example,  artillery  and  tactical  aircraft?  How  should 
all  these  models  be  constructed  so  that  the  output  of  each  is  presented  in 
both  usable  form  for  analysis  and  with  tactical  realism  for  the  players? 


As  an  example  relating  to  the  first  question,  if  the  research  question 
was  to  investigate  the  surveillance  capability  of  a  division  in  order  to 
determine  the  detection  rate  of  ground  and  airborne  sensors,  the  war 
gamer  would  have  to  build,  in  detail,  one  model  depicting  the  capability 
„4jjLeachJi)qpe  pi  ground  and  airborne  sensor  including  its  associated  de¬ 
livery  vehicle.  These  models  would  presumably  allow  the  division 
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would  produce  sufficient  data  for  analysis.  If  the  particular  play  was  not 
directed  at  the  surveillance  question,  an  aggregate  model  depicting  the 
intelligence  acquisition  capabilities  of  the  airborne  sensors  could  be 
built. 

The  third  question  concerning  the  presentation  of  the  output  of  the 
models  contains  several  requirements.  The  desired  data  for  analysis 
must  be  presented  in  a  format  that  can  be  easily  manipulated  manually 
or  by  a  computer  program.  With  the  same  format,  the  game  assess¬ 
ments  which  contain  the  data  for  analysis  should  be  presented  unambigu¬ 
ously  to  the  players  and  contain  as  much  but  no  more  information  as  could 
be  expected  to  arise  In  actual  combat  under  the  same  conditions  that  the 
model  attempts  to  simulate.  Without  relaxing  the  above  requirements, 
the  recording  of  the  assessments  in  a  data  format  must  not  be  time  con¬ 
suming,  Otherwise  the  time  saved  during  the  analysis  by  preplanning 
the  organization  of  the  game  data  will  be  lost  by  the  data  recording  pro¬ 
cess  during  the  play  of  the  game. 

DESCRIPTION  OF  TACSFIEL,.'.  So  far  I  have  discussed  the  design  of 
manually  played  war  games  pointing  out  the  requirements  for  a  basic 
tactical  structure,  associated  sub-models,  and  data  format. 

I  will  now  describe  TACSPIEL,  RAC's  division -level  war  game,  as 
an  illustration  of  the  application  oPthe  foregoing  design  principles  and 
requirements, 

V 

The  objective  of  TACSFIEi.  is  ",  ,  .  to  study  operational  problems 
of  ground  combat  at  division  and  lower  echelon  by  analysis  of  play  of  a 
detailed  tactical  war  game".  The  objective  sets  the  framework  within 
which  tlie  game  was  designed. 

TACSPIEL  is  two-sided,  free -play,  analytic,  rigidly-assessed,  and 
manually  operated,  It  is  a  free  play  game  since  after  each  side  has  been 
given  their  forces,  scenarios,  assigned  missions,  and  approximate  lo¬ 
cation  of  their  respective  reconnaissance  elements,  they  are  not  constrained 
in  their  concepts  Of  Operation  and  organization  other  than  the  rnnui  rpmnnt 
to  stay  within  the  45  x  200  km  area  of  play, 

It  is  analytic  in  that  it  is  engineered  to  support  research  as  a  tactical 
environment  for  controlled  experimental  simulation  of  operational  capa¬ 
bilities  with  a  view  toward  securing  data  for  analysis  of  their  performance. 
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By  rigid  assessment  it  is  meant  that  the  game  is  conducted  using  a 
manual  of  rules  that  are  as  detailed  as  the  years  of  operation  and  present 
ingenuity  can  make  them,  and  that  they  limit  Control  as  well  as  the  players. 
The  assessment  of  movement,  contact,  and  battle  are  done  by  two  ground 
assessors,  one  representing  Blue,  and  the  other  Red.  They  must  agree 
on  the  assessments  that  arise  from  interaction  between  the  opposing 
forces  that  the  gams  rules  recognize.  When  unreconcilable  situations,  or 
situations  and  capabilities  unprovided  for  by  the  rules  arise,  the  senior 
controller  intervenes, decides  or  umpires  the  offending  assessment,  and 
a  ndw  rule  or  a  clarification  of  an  old  one  is  generated.  Thus,  the  game 
manual  is  a  living  document,  and  some  umpiring  doeB  occur.  But  this 
organisation  of  game  assessment  is  believed  to  provide  the  most  object¬ 
ive  and  well-defined  experimental  conditions  for  a  manually -conducted 
game  that  can  be  attained. 

The  game  is  played  on  1:25,  000  scale  relief  models  of  an  area 
44  x  90  km.  The  terrain  selected  Is  considered  to  influence  but  not  do¬ 
minate  the  operations  at  division  level.  The  relief  models  depict  three 
classes  of  roads,  the  railroads,  all  military  streams,  three  classes  of 
vegetation,  all  built-up  areas  and  other  limitations  to  movement.  The 
relief  is  shown  as  20  meter  contour  steps,  with  2:1  vertical  exaggeration. 
The  interval  of  piay  is  30  minutes,  and  Unit  deployments  are  known  to 
the  1  x  1  km  square.  The  organization  of  units  Is  resolved  to  the  com¬ 
pany,  battery  and  armored  platoon  levels.  This  resolution  at  company 
level  was  dictated  by  the  lack  of  predictive  data  at  lower  echelons  for  use 
as  inputs  to  the  battle  model.  Battery  and  armored  platoon  resolution 
was  required  to  permit  flexibility  and  realism  in  the  employment  of 
artillery  and  reconnaissance  elements.  The  foregoing  details  apply  to 
the  basic  tactical  structure  that  exists  in  order  to  generate  the  operational 
environment.  For  research  purposes,  locations  of  point  objects  such  as 
radars,  OPs,  minefield  lanes,  and  boundaries  can  be  specified  to  the 
nearest  100  x  100  m;  timing  of  events  can  be  reckoned  to  the  nearest  5 
minutes;  and  individual  patrols  can  bo  assessed.  The  presence  or  ab¬ 
sence  of  this  latter  kind  of  expensive  detail  largely  depends  on  research 
objectives  requiring  them  in  any  given  play. 

As  discussed  before,  the  basic  tactical  structure  of  a  war  game  must 
contain  the  models  for  movement,  contact,  and  battle  or  resolved  units. 
These  and  other  models  developed  to  reflect  the  division's  capabilities 
and  tactical  realism  are  shown  in  Figure  1.  (Figures  can  be  found  at  the 
end  of  this  article.) 
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MOVEMENT  MODEL.  The  movement  model  is  designed  to  reflect 
a  unit's  maneuver  capability.  At  the  level  of  resolution  played,  this  model 
represents  in  effect  the  movement  rate  of  the  center  of  mass  of  the  unit. 
The  movement  model  permits  cross-country  and  road  movement,  de¬ 
ployed  or  in  column  for  tracked  and  wheeled  vehicles  and  dismounted 
troops.  Reductions  and  restrictions  on  the  rate  of  movement  occur  when¬ 
ever  the  slope  of  the  terrain  is  excessive,  dense  vegetation  is  encountered, 
escarpments  occur,  or  when  moving  under  artillery  fire. 

CONTACT  MODE1*  The  contact  model  was  developed  to  reflect  a 
unit's  visual  and  oral  detection  capability.  In  order  to  permit  terrain  to 
play  its  natural  role  on  the  battlefield,  ridge  lines  are  present  on  the 
terrain  board  in  the  Control  Room.  If  any  part  of  a  unit's  deployment  area 
is  in  a  terrain  cell,  as  defined  by  the  Control  terrain  model  ridge  lines, 
it  is  assumed  that  the  unit  exercises  the  full  surveillance  capability  in 
that  cell.  Further,  enough  of  the  unit  is  in  that  ceil  to  provide  a  com¬ 
plete  sample  of  the  unit  for  enemy  visual  surveillance  and  possible  com¬ 
plete  reporting. 

Since  in  actual  combat,  initial  visual  contact  does  not  always  result 
in  perfect  identification  as  to  the  size  and  type  of  the  contacted  force, 
a  distribution  of  possible  identifications  is  used  to  detvrmine  the  content 
of  tho  contact  report. 

A  three-digit  code  is  used  to  report  the  size  and  type  of  the  contacted 
unit.  The  zize  of  the  contacted  unit  can  be  reported  accurately,  or  simply 
as  "unknown",  The  type  of  unit  may  be  reported  accurately,  i.  e,  ,  medium 
tanks,  8-in  How,  etc.  ,  or  given  a  general  identification,  i.  e.  ,  armor, 
artillery,  etc.  or  just  as  "enemy".  The  output  of  the  assessment  of  con¬ 
tact  is  a  contact  report.  The  information  contained  in  this  report  includes 
the  size  and  type  of  the  enemy  unit  as  obtained  from  the  identification  dis¬ 
tribution,  its  location  when  contacted,  or  its  location  when  contact  was 
broken,  its  attitude,  i.  e,  moving  halted,  deployed,  in  column,  and  if 
moving,  its  direction  of  movement, 

BATTLE  MODEL.  The  third  part  of  the  basic  structure,  the  battle 
modei,  is  tne  most  difficult  model  to  design.  If  the  battle  model  attempted 
to  depict  squad  combat,  how  would  one  predict  the  behavior  under  a  set 
of  battlefield  conditions  of  a  squad  without  including  the  make-up  of  the 
individuals?  At  TACSPIEL's  level  of  resolution,  the  company,  group 
prediction  is  possible  and  feasible  because  of  available  basic  knowledge 
from  experience.  This  model  must  motivate  the  players  to  win.  At  the 
same  time,  the  model  must  bs  as  simple  and  quick  to  u»b  as  possible. 
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While  the  basic  time  resolution  is  one-half  hour,  battles  are  assessed 
on  an  hourly  basis.  That  is,  engagements  are  assessed  once  each  hour 
of  engagement.  No  winner  or  loser  is  declared  but  rather  each  force 
may  accumulate  casualties  and  the  battle  location  can  change  if  the 
attacker  is  successful.  At  the  end  of  each  hour  of  battle,  the  commanders 
receive  reports  of  their  own  casualties,  movement  of  the  forces,  and  an 
estimate  of  casualties  Inflicted  on  the  enemy.  At  that  time  they  may 
attempt  to  reinforce  or  withdraw  engaged  units, 

In  ths  assessment  of  a  battle,  the  engaged  units  basic  combat  effect¬ 
iveness,  their  casualties  at  the  start  of  the  battle  hour  and  the  amount 
of  casualties  caused  by  enemy  supporting  artillery  are  used  to  calculate 
an  attacker  to  defender  force  ratio.  This  force  ratio  is  then  used  to 
determine  by  random  number  selection  that  hour's  battle  casualties 
Oil  the  attacker  and  defender,  and  the  penetration  of  a  successful  attacker. 

AHTUiLERY  MODEL,  Since  artillery  has  a  capability  which,  In  ths 
real  world,  the  division  commander  is  able  to  employ  with  a  high  flexi¬ 
bility  and  effectiveness,  the  artillery  model  must  be  built  to  realistically 
reflect  this  capability,  The  emplacement  time,  rate  of  fire  of  the  wea¬ 
pons,  end  the  availability  of  the  ammunition  are  the  limitation!  on  the 
employment  of  artillery.  Since  the  effectiveness  of  rounds  of  different 
caliber  to  produce  casualties  vary,  a  standard  unit  of  effectiveness  called 
the  fire  unit  or  FU  is  used.  One  FU  is  equivalent  in  casualty  production 
to  24  105-mm  Howitser  HE  rounds.  The  effectiveness  of  rounds  of  other 
calibere  is  equated  to  this  measure,  Thus,  all  fire  missions  are  des¬ 
cribed  and  assessed,  and  a  battery's  basic  load  and  resupply,  computed 
in  fire  units, 

The  assessment  of  casualties  is  based  on  the  number  of  fire  units 
delivered,  the  type  of  target  (armored,  personnel)  and  posture  of  the 
target  (exposed,  attacking,  defending,  in  woods,  etc.  )  and  the  extent 
of  observation  on  the  target. 

The  results  of  a  fire  mission  are  reported  to  the  side  firing  and  the 
side  receiving  the  shelling.  The  number  of  fire  units  expended,  the  type 
ot  target  fired  upon,  and  the  target's  location,  are  reported  from  the  firing 
battery.  If  the  fire  is  observed,  an  observer's  report  will  contain  the 
type  and  location  of  the  target,  an  estimate  of  the  damage  inflicted,  and 
the  firing  battery's  designation  to  indicate  what  fire  mission  was  being 
observed.  For  the  unit  receiving  the  fire,  a  shell  report  is  generated  con¬ 
taining  an  estimate  of  the  amount  of  fire  received  and  the  amount  of 
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AIR  OPERATIONS  MODEL,  The  air  operations  model  is  designed  to 
include  the  employment  of  air  defense  artillery,  tactical  aircraft  against 
ground  targets  in  support  of  engaged  troops  and  against  ground  targets 
behind  the  enemy  lines,  airlift  capability  for  divisional  troops,  and  organic 
helicopters  used  in  a  reconnaissance  role  or  to  deliver  fire  from  the  air. 

The  effectiveness  of  the  tactical  aircraft's  ordnance  is  equated  to  the 
artillery  fire  unit.  Three  stages  of  tactical  air  alert  are  played;  No 
Alert,  Standby,  and  On-station  CAP.  Three  types  of  air  missions  are 
played,  specific  target,  armed  reconnaissance,  and  battle  support. 
Appropriate  planning  times  are  assessed  against  aircraft  when  ordered 
from  one  of  the  air  alert  stages  into  one  of  the  air  missions, 

Air  defense  artillery  kill  probabilities  are  based  on  their  rate  of 
fire,  engagement  ranges,  altitude  and  speed  of  the  aircraft, 

The  output  of  the  air  operations  model  is  a  report  indicating  the 
number  of  aircraft  in  the  mission,  the  number  surviving,  and  the  result 
of  the  mission. 

GROUND  AND  AIR  SURVEILLANCE  MODELS.  To  reflect  the  division's 
surveillance  capability,  OPs,  patrols,  and  surveillance  radars  for  the 
detection  of  moving  personnel  and  vehicles  are  playetj  in  the  ground  sur¬ 
veillance  model.  The  characteristics  of  the  radars  are  obtained  from 
the  results  of  field  tests.  , 

The  reconnaissance  and  surveillance  capabilities  of  several  air¬ 
borne  devices  and  agencies  are  amenable  to  war-game  simulation.  For 
the  purpose  of  TACSpIEL,  however,  only  those  systems  designed  to  con¬ 
centrate  in  the  10 -km  area  immediately  beyond  the  line  of  contact  are 
played, 

Based  on  the  previous  plays  in  which  each  surveillance  mission  beyond 
10-km  from  the  DC  was  individually  played,  an  aggregate  effectiveness 
has  been  developed  for  the  surveillance  capability  in  the  zone  In  excess 
of  10  km  beyond  the  LC.  This  aggregated  deep  penetration  surveillance 
includes  information  gathered  by  air  photos,  infrared  devices  and  side¬ 
looking  air-borne  radars. 

The  output  of  both  the  ground  and  air  surveillance  models  reflects 
the  normal  capabilities  of  each  sensor. 
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LOGISTICS  AND  VEHICLE  BREAKDOWN  MODELS.  The  next  model 
illustrates  how  TACSFIEL  was  applied  to  generate  data  to  support  analy¬ 
sis  of  a  research  question.  The  research  question  concerned  an  analysis 
of  consumption  and  resupply  in  the  ROAD  Division  of  Class  III  and  V 
Supplies.  To  generate  the  data,  a  tactical  logistics  model  was  developed. 

The  modei  assumed  an  infinite  stock  of  ammunition  at  the  Army 
Supply  Point.  Using  the  organic  transportation  available  in  the  division, 
the  player  was  required  to  order  up  the  ammunition  he  needed  under  a 
side  condition  that  the  fuel  for  the  divisional  units  must  be  hauled  simul¬ 
taneously  out  of  the  same  transportation  capability. 

All  basic  loads  and  ordering  of  ammunition  were  reduced  to  one  unit, 
the  "fire  unit"  of  effect.  The  POL  consumption  rates  and  basic  loads  of 
the  various  units  were  also, reduced  to  a  single  "consumption  unit"  or 
CU,  equal  to  18  gallons  of  gasoline.  Finally,  the  transport  available  to 
haul  the  basic  loads  and  resupply  Class  III  and  V  was  reduced  to  a  "trans¬ 
portation  serial"  equivalent  to  7  1/2  tone  of  lift.  In  this  manner,  players 
could  requisition  ammunition,  POL,  and  transport  in  a  system  of  units 
that  was  Independent  of  the  detailed  tables  of  equipment  of  the  organization 
concerned. 


TACSPIEL  has  undertaken  on  a  trial  basis  a  model  to  simulate 
vehicle  maintenance  and  mechanical  failure  of  combat  vehicles.  Vehicle 
maintenance  in  the  division  is  simulated  by  assuming  that  the  love!  of 
availability  of  wheeled  vehicles  is  in  a  steady  state  during  the  play  of  the 
game.  The  level  of  availability  is  assumed  to  be  80  percent  for  units 
having  five  or  more  trucks  over  one  ton  carrying  capacity.  This  20 
percent  Iob  •  of  hauling  capacity  is  reflected  through  reduction  in  basic 
loads  of  Class  III  and  V  supplies  available  to  the  player,  and  in  resupply 
capabilities. 


The  breakdown  model  has  been  developed  from  data  from  field  trials 
on  the  M60  tank  and  Ml  13  AFC.  This  model  simulates  mechanical 
failure  of  APC,  armored  vehicles  and  SP  artillery.  During  each  interval 
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If  breakdown  occurs,  the  unit  effectiveness  is  degraded  5  percent.  At 
appropriate  times  during  the  game,  vehicles  repaired  at  the  divisional 
support  group  are  returned  to  the  game. 


By  adding  new  simulation  models  and  proving  them  out  TACSPIEL 
can  expect  to  increase  its  potential  to  produce  useful  data  for  research. 
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MECHANIZATION  OF  TACSPIEL,  The  method  by  which  game  data 
are  made  available  for  analysis  is  by  employing  IBM  punch  cards  as  a 
medium  of  exchange  for  the  vast  bulk  of  orders  and  reports  and  for  the 
recording  of  data.  A  vocabulary  of  codes  has  been  developed  to  trans¬ 
mit  the  game  messages  between  the  players  and  Control.  The  orders 
recognised  by  the  game  rules  and  the  assessments  are  punched  on  IBM 
cards  using  IBM  port-a-punch  holders  and  40 -column  partially  preper¬ 
forated  cards.  These  40-column  cards  are  divided  into  several  fields. 

One  format  is  used  for  player  orders  and  another  for  assessments 
(Figure  2).  These  formats  are  designed  to  include  a  three-digit  order 
code  or  report  code,  the  unit's  order  of  battle,  its  coordinates,  and  all 
pertinent  information  in  the  order  or  assessment. 

The  flow  of  orders  from  the  players  to  Control,  the  assessment  of  the 
interactions  pursuant  to  the  orders,  and  the  reporting  of  the  results  to 
the  players  Is  called  the  Order-, A ssess-Report  Cycle  (Figure  3), 

The  player-commanders  write  their  mission  orders  and  organize 
their  units  for  combat  using  overlays  and  mission  order  forms,  (Figure 
4).  The  written  orders  are  translated  into  TACSPIEL  order  codes  in  the 
ORDERS  column  of  this  form  (Figure  5).  After  coding  the  orders,  the 
orders  are  punched  on  the  40-column  IBM  cards,  using  the  ORDER  for¬ 
mat.  These  cards  then  go  to  Control  with  their  ground  mission  order, 

Upon  receipt  by  Control  of  the  IBM  cards,  the  data  on  these  cards 
are  transferred  to  standard  80 -column  IBM  cards  by  an  IBM  Summary 
Punch.  The  80-column  cards  are  thep  used  to  prepare  a  worksheet  for 
the  asseeaors  called  the  Unit  History#  Form.  The  format  (Figure  6) 
groups  the  combat  units  with  their  initial  coded  orders  as  they  are  or¬ 
ganized  for  combat  on  the  mission  order  to  provide  continuity  in  time 
and  to  help  organize  the  assessor  Is  work.  Additional  headings  (ORDer, 
ACTion,  POSition)  are  printed  to  permit  the  assessors  to  enter  Interval 
by  interval  any  changes  in  orders  from  the  players  and  assessment  notes 
for  each  unit.  Enough  space  on  each  page  is  available  for  listing  units 
that  become  attached  to  an  organization  during  the  game.  When  the  first 
page  is  filled,  additional  pages  are  produced  which  may  reflect  changes 
in  che  make-up  of  the  combat  organization, 

After  the  Unit  History  Forms  have  been  prepared,  the  action  of  the 
opposing  forces  is  assessed.  Reports  generated  by  interactions  are 
punched  on  the  IBM  cards  in  the  Assessment  Format,  transferred  by 
the  IBM  Summary  Punch  to  standard  IBM  cards  containing  prepunched 
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military  English,  listed,  and  distributed  to  the  players.  For  example, 
the  output  of  an  artillery  assessment  would  use  Code  801  for  the  firing 
j  unit's  report  and  Code  750  for  the  observer's  report,  and  the  assessment 

f  by  Control  would  be  listed  from  the  IBM  cards  (Figure  7).  The  percent 

|  casualties  to  the  enemy  unit  and  its  order  of  battle  would  be  deleted  from 

f  the  player's  copy. 

The  player's  response  to  the  reports  results  in  new  orders  by  which 
a  new  Order-Assess-Report  cycle  is  generated.  Unless  the  general 
mission  of  a  combat  team  is  changed,  the  mission  order  form  is  not 
required  for  transmitting  additional  orders  affecting  that  combat  team. 

By  the  use  of  the  IBM  cards  and  the  mission  order  forms,  a  complete 
rapidly  accessible  record  of  the  game  is  available  for  analysis.  In 
addition,  by  the  expedient  of  reproducing  the  cards,  the  data  become 
accessible  to  any  qualified  study  outside  the  gaming  group  itself, 

SUMMARY.  To  summarise,  in  the  design  of  a  war  game,  a  basic 
operational  structure  of  movement,  contact,  and  battle  Is  required. 

Within  this, structure  detailed  simulations  of  th«  real  world  events  to  be 
studied  are  Introduced  in  order  to  generate  data  to  answer  the  specific 
research  questions  of  the  military  customer, 

In  order  to  extract  the  data  to  answer  the  research  questions  rapidly 
and  efficiently,  the  TACSPIEL  war  game  has  developed  a  method  which 
combines  a  vocabulary  of  order  and  assessment  codes  with  IBM  cards. 

The  result  is  a  compact  and  complete  game  record  for  analysis  and  a 
data  source  on  which  analytic  research  can  be  based. 
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EVALUATION  OF  PERFORMANCE  RELIABILITY 
USING  REGRESSION  MODELS 

Seymour  K.  Einbinder ,  Picatinny  Arsenal 
and 

Ingram  Olkin,  Stanford  University 

O.  ABSTRACT.  Performance  reliability  is  the  probability  that  a 
weapon  will  perform  its  prescribed  function  under  given  conditions  of  en¬ 
vironment  at  some  particular  time.  Performance  reliability  models  are 
defined  for  continuous  performance  response  variables.  Procedures  are 
then  described  for  the  evaluation  of  reliability  with  emphasis  on  the  appli¬ 
cation  of  univariate  and  multivariate  regression  analysis  to  single  and 
multiple  continuous  response  variables,  respectively,  Point  and  confi¬ 
dence  interval  estimation  methods  for  performance  reliability  are  dis¬ 
cussed,  and  a  sample  problem  is  presented  illustrating  some  of  the  basic 
concepts  and  results. 

1.  1NTRODUC TION.  A  major  problem  during  the  research  and  de¬ 
velopment  of  a  weapon  or  warhead  is  the  assurance  of  high  functioning  re¬ 
liability  of  the  final  prototype  design,  The  reliability  concepts  and  eval¬ 
uation  methods  to  be  deicribed  are  general  and  are  applicable  to  a  wide 
variety  of  systems  and  components; 

A  weapon  during  its  lifetime  may  be  subjected  to  many  environ¬ 
mental  factors  or  stresses  such  as  temperature,  vibration,  acceleration, 
rough  handling,  etc.  In  addition,  the  stresses  may  be  encountered  singly, 
simultaneously  or  in  sequence.  The  problem  of  testing  and  estimating  re¬ 
liability  is  of  importance  to  the  weRpon  doveloper  in  order  to  Assure  the 
User  of  a  reliable  weapon  for  use  in  any  potential  combat  situation, 

The  establishment  of  high  reliability  with  a  high  level  of  confidence 
generally  requires  the  testing  of  larger  numbers  of  items  than  are  usually 
available  during  a  development  program  for  a  complex  and  expensive  item. 
Thus,  it  is  generally  necessary  to  obtain  the  most  information  with  a 
minimum  number  of  samples  and  tests.  Improved  and  more  efficient 
statistical  methods  are  required  in  many  cases  to  solve  the  reliability 
estimation  problem, 

Before  solutions  to  a  problem  can  be  obtained,  it  is  important  to 
delineate  the  problem  so  that  a  representative  mathematical  model  can 
be  developed.  Obviously,  any  solutions  obtained  can  be  no  better  than 
the  underlying  mathematical  model  which  is  assumed  as  a  prototype  of 
the  problem. 
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In  a  previous  paper  (3J  ,  the  emphasis  was  on  test-to-failure  and 
stress  vs,  strength  analyses  for  single  and  multiple  environments  (stresses). 
The  present  paper  is  concerned  mainly  with  reliability  in  the  case  of  a 
continuous  regression  response  surface,  and  thereby  is  an  extension  of  1 3 j  . 
Methods  of  point  and  interval  estimation  for  the  univariate  and  multivariate 
regression  problems  are  discussed. 

2.  RELIABILITY  CONCEPTS.  Reliability  of  a  weapon  may  be  defined 
as  the  probability  of  a  successful  functioning  under  required  conditions  of 
the  environment  at  some  particular  time.  Successful  functioning  might 
require  the  successful  operation  of  several  or  all  components  of  a  system. 

The  outputs  or  responses  of  each  component  may  he  attribute  or  continuous  . 

In  the  case  of  the  continuous  response,  success  may  require  that  the  response 
lie  within  certain  limits  (possibly  specification  limits), 

To  illustrate  these  concepts,  a  hypothetical  shaped  charge  warhead 
section  for  a  missile  will  be  used  as  an  example.  Successful  functioning 
of  the  warhead  section  may  require  that  the  S  and  A  (Safety  and  Arming 
Device)  must  arm  and  detonate  the  warhead  on  target  impact,  and  the 
warhead  must  then  penetrate  at  least  a  specified  distance  into  an  armor 
plate  target,  This  example  could  be  further  complicated  by  specifying 
arming  limits  for  the  S  and  A.  Failure  of  the  warhead  section  may 
occur  in  two  fundamental  ways* 

(1)  a  complete  dud  or  catastrophic  failure  may  result  such  that  no 
warhead  detonation  takes  place,  or, 

■  '■■■."■  ''  ■ 

(2)  the  warhead  explosive  train  may  be  initiated  but  the  armor  pene¬ 
tration  requirement  may  not  be  met.  /  - 

The  reliability  of  the  warhead  section  is  given  by 
R  =  (1  -  PD)  rwhd, 


where  R  is  the  overall  warhead  section  reliability,  is  the  pro¬ 
bability  of  a  dud  or  catastrophic  failure,  and  1®  the  conditional 

probability  that  the  warhead  exceeds  the  specified  performance  require¬ 
ment.  The  latter  will  be  referred  to  as  the  performance  reliability  and 
is  of  prime  concern  in  this  paper.  The  dud  probability  can  be  broken  down 
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further  according  to  various  components.  In  general  it  is  necessary  to 
evaluate  the  dud  or  catastrophic  failures  separately  from  the  performance 
failures  since  they  do  not  have  the  same  distribution  and  are  mutually  ex¬ 
clusive.  Dud  failures,  being  attribute,  normally  require  larger  sample 
sizes  for  evaluation  with  the  same  precision  and  confidence  levels  as 
would  p<? rforrnance  reliability  based  on  continuous  variable s , 

The  remainder  of  this  paper  will  be  concerned  with  the  evaluation  of 
the  performance  reliability, 

3.  MATHEMATICAL  MODELS,  In  this  section  we  define  the  mathe¬ 
matical  models  upon  which  subsequent  analysis  is  based.  Univariate  and 
multivariate  responses  and  single  and  multiple  stresses  are  considered, 
Estimation  procedures  are  described  in  the  subsequent  sections. 

3.1  Univariate  Response.  We  have  defined  performance  reliability  as 
the  probability  that  a  continuous  performance  variable  lies  within  certain 
specified  limit*.  Thus,  it  may  bo  required  that  the  arming  time  for  tn  S 
and  A  Device  be  greater  than  some  minimum  time  required  for  safety,  The 
performance  variable  or  response  may  be  thought  of  as  a  dependent  variable 
which  is  a  function  of  one  or  more  environments  or  stresses  which  are  the 
independent  variables,  In  general,  this  functional  relationship  is  unknown; 
however,  we  can  approximate  the  response  function  over  small  regions  of 
the  function  space  by  linear  regression  methods.  Generally,  we  are  con¬ 
cerned  with  the  reliability  under  some  critical  stress  conditions,  These 
conditions  will  be  referred  to  as  a  critical  point  or  critical  reliability 
boundary.  The  regression  experiment  is  designed  to  provide  the  best  infor¬ 
mation  in  the  vicinity  of  this  point.  Figure  1  illustrates  the  experimental 

design  in  general  terms  for  the  univariate  case,  (x, ,  ...  ,  x  )  represent 

l  m 

the  applied  stresses  or  environments  such  as  temperature,  vibration,  etc., 
and  the  elements  of  the  design  matrix  represent  the  levels  of  each  of  these 
stresses.  For  example,  ^  represents  the  second  level  of  the  stress  x., 
etc,  The  column  titled  response  vector  represents  the  dbserved  response 
obtained  with  each  treatment  combination.  The  response,  y,  is  a  contin¬ 
uous  variable  such  as  arming  time  in  the  case  of  the  fuze,  or  possibly  depth 
of  penetration  in  the  case  of  a  shaped  charge  warhead;  the  response,  y^ 
for  the  i^h  treatment  combination  may  be  expressed  as  a  linear  combination 
of  the  treatment  levels  plus  some  random  error.  The  regression  model  and 
underlying  assumptions  are; 
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y  s  X'  p  +  u  , 


y.  n  x  1  is  the  observation  vector, 

u:  n  x  1  is  the  vector  of  random  errors,  and  is  normally  distri¬ 

buted  with  mean  vector  O  and  covariance  matrix  <r^I,  is  e.  , 
E(u)  =  O,  E(u  u')  B  <r2I, 

X;  m  x  n  is  the  design  matrix  of  rank  r,  r  <  m  <  n, 

p:  m  x  1  is  the  vector  of  regression  coefficients, 


A  geometrical  interpretation  of  this  regression  model  and  its  relation  to 
performance  reliability  is  shown  in  Figure  2  [Tables  and  figures  can  be 
found  at  the  end  of  the  article. j  for  the  univariate  response  case,  (xj,  ,  , 


x  )  are  the  stress  variables,  (c., 
m  1 


c  )  are  the  components  of  the 
m 


critical  reliability  boundary  vector  c.  The  points  shown  in  the(xj,  .  ■  -  i*m) 

plane  represent  the  treatment  combinations  for  the  regression  experiment, 

and  the  average  response,  y,  is  represented  by  the  regression  surface 

shown  above  the  points.  The  regression  equation  provides  estimates  of 

the  response  for  any  point  in  the  (x.,  .  .  .  ,  x  )  space,  The  response  y  at 

i  m 

some  point  such  as  the  critical  reliability  boundary  c  ;  m  x  1  is  denoted 

(c)  2 

by  y  'and  Is  distributed  according  to  N(c'  p,  «r  ).  The  lower  performance 

limit  which  the  response  y^  iB  required  to  exceed  is  denoted  by  y^,  *nd. 
consequently,  the  performance  reliability  R  is  given  \jy: 

(1)  R(c)  =  p(y(c)  >  y(0))  -  j*  n(y^|  c.«  p,  /)  dy(c)  3  gl(c'  *  1  c)  ' 

where  n(x  j  ^  ,  <r2)  is  the  density  function  for  a  normal  population  with 

n 

mean  |i  and  variance  <r“,  This  expression  represents  the  shaded  area 
under  the  normal  curve  shown  in  Figure  2. 

Thus,  our  problem  is  to  estimate  g  which  is  a  function  of  the  un¬ 
known  parameters  p,  <t2,  and  the  fixed  point  c,  based  upon  a  sample  of 
size  n  treated  as  a  single  or  multiple  regression  experiment. 
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3.  2  Multivariate  Response.  The  univariate  model  will  now  be  ex¬ 
tended  to  include  cases  where  more  than  one  continuous  response  may  be 
observed  on  a  single  experimental  unit  such  as  S  and  A  arming  time, 
functioning  time,  and  self-destruct  time;  also,  the  respo  hqs  may  bo 
correlated.  Multivariate  analysis  techniques  permit  the  correlation  be¬ 
tween  responses  to  be  investigated.  As  before,  the  problem  is  best 
illustrated  by  examining  the  table  shown  in  Figure  3,.  The  design  ma¬ 
trix  X  Is  exactly  the  same  as  for  the  univariate  case;  (x^,  .  .  .  ,  xj  is 

still  the  vector  of  applied  stresses.  However,  instead  of  a  single  re¬ 
sponse  vector  of  y's,  we  now  have  p  responses  (y,,  ...,  y  ).  Thus, 

*  * 

for  each  treatment  combination  we  observe  p  responses  so  that  our 
response  vector  for  the  univariate  case  has  now  become  a  response  ma¬ 
trix  where  the  column  vectors  may  be  correlated,  and  the  rows  which 
represent  independent  response  vectors  are  uncorrelated.  The  multi¬ 
variate  model  and  assumptions  are; 


Y  »  X'  B  +  U, 

Y;  n  x  p  is  the  response  matrix 

X:  mxn  is  the  design  matrix  of  rank  r  <  m  <  n,  p<n-r, 

B;  m  x  p  is  the  matrix  of  regression  coefficients, 

U:  n  x  p  is  the  error  matrix, 

.  .  .  ,  n  are  the  row#  of  U  and  are  independently  and 
J  identically  distributed,  each  having  a  p-variate 

normal  distribution  with  mean  vector  O  and 
positive  definite  eo variance  matrix  32. 


From  the  multivariate  model,  a  p  x  1  response  vectori^ 
tained  for  the  response  at  the  critical  reliability  bounda^^"c,tor  c,  m  x  1 

The  response  vector  y^  is  distributed  according  t^4$(c'B,  «g)(  in  which 
the  p  x  p  covariance  matrix  32  takes  into  acco^nf  iny  correlations  be¬ 
tween  responses. 


The  performance  reliability 
given  by: 


multiple  response  case  is 
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[l)  R(c)  =  p(y|c)  > 


.(°)  v(cKJO) 


1 


»  •  *  •  » 


J  •  J 

(o)  (0) 


n(y(c)|c'  B,  S)  dy.(c) 


Jv(c) 

% 


f-p  (C  B,  2;  c)  . 


A  graphical  representation  of  the  performance  reliability  in  two  di¬ 
mension*  i*  shown  in  Figure  4  for  the  multivariate  case.  The  above  in¬ 
tegral  represents  the  volume  of  the  multivariate  normal  density  function 
over  the  shaded  quadrant  whose  vertex  y(^)  is  the  vector  of  specification 
limits, 

Thus,  the  general  problem  may  be  summarised  as  follows;  Baaed 
upon  the  results  of  a  suitable  experimental  design  with  a  sample  of  aise  n, 
it  is  required  to  eatimate  the  g  function  for  the  univariate  and  multi¬ 
variate  cases,  both  by  point  estimation  and  confidence  limits. 

4.  POINT  ESTIMATION  ■  The  general  problem  is  to  estimate  the 
performance  reliability  functions  defined  for  the  univariate  and  multi¬ 
variate  responses  both  by  a  point  estimate  and  confidence  limits  based 
upon  responses  observed  on  a  sample  of  size  n  subjected  to  various  stress 
treatments  in  accordance  with  a  suitable  experimental  design,  The  experi¬ 
mental  designs  used  for  exploring  response  surfaces  [l,  2\  are  generally 
suitable  for  exploring  the  region  around  the  critical  reliability  boundary. 

4,1  Univariate  Point  Estimates.  The  g  or  R  functions  to  be  esti¬ 
mated  may  be  written  as  follows  for  the  univariate  case: 

R(P,  o'2)  £  gj(c  '  p,  o'2;  c)  =  j*  (2tr)  1//2  exp  (-t“/2)  dt, 

(y(0)-c'p)/<r 
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where  c  and  (3  are  m  x  1  vectors, 
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We  consider  three  types  of  point  estimates.  Suppose  we  write 

K(M)'(y(0)  -CfJ)A  , 

then 

(3)  R(p,  ff2)a  J  (21T)"1/2  exp  ( -tZ/2)  dt. 

K(p,  c) 

The  first  estimate  of  R  is  based  on  using  K(3,<r),  where  p  and  s'  are 
appropriate  estimates  of  p  and  <r. 

The  least  squares  estimate  of  |3  is  given  by 

(4)  P  -  (XX'}"^  y  , 

where  X:  mxn,  of  rank  m  <  n,  is  the  design  matrix,  and  y  !  n  i  1  Is 
the  response  vector.  An  unbiased  estimator  of  <r^  is 


Thus,  we  may  use  the  estimate 


(6)  K(pA)  -  (y(0)  -  c'p)A  , 
from  which  we  obtain 

(7)  R-CfSA")  *  j  (Zir)"*/*"  exp  (-t“/2)  dt. 


A  second  estimate  is  based  on  the  UMVU  estimate  of  K,  namely 
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(8) 


K ip.  it) 
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r4> 

nT-> 


K(P,a) 


where  f  =  n-m  ,  *rora  which  we  may  use 


(9)  R(p,<r2)«  j'  (2ir)"l//2  exp  (-tZ/2)  dt 

K<(5,<r) 

»  ..  •  *  ' 

2 

as  an  estimate  at  R{{5,  o-  )  , 

Although  K  is  a  UMVU  estimate  of  K,  it  is  not  the  case  that  R 
is  a  UMVU  estimate  of  R.  Consequently,  a  third  procedure  is  based 
on  the  OMVU  estimate  of  R,  t4]  ,  and  is  given  by 


where  =  — 


(y(1Q)  ■  c.'p)  ... 

2aif{i-c'  (XX')*J'e) 


f(l-c’(XX')  c) 


—  2 

Note  that  R(f5,  v  )  «  1  if  T^l,  and  that  the  estimate  is  valid  for  criti¬ 
cal  vectors  c  such  that  c^XX')  <  1. 

Unfortunately,  comparisons  of  the  risk  of  these  estimators  are  un¬ 
available,  since  the  determination  of  the  variance  is  quite  complicated, 
and  was  not  attempted  in  this  paper. 
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4.  2  Multivariate  Case.  In  the  multivariate  case,  we  have 


where  Y  ;  n  x  p,  X  ;  m  x  n,  B  •  m  x  p,  As  in  the  univariate  case, 

we  cap  conaidf.*  «(£,  S)  as  an  estimate  of  R(B,  E),  where  B  «{XX')"1XY 
and  t  m(Y  -  X#B)'(Y  -  X’B)  /  [p(n-m)3  .  The  problem,  however,  is  still 
to  evaluate  the  multivariate  normal  distribution  over  an  orthant,  In 
fact,  whether  we  use  this  estimation  procedure  or  another,  the  diffi¬ 
culty  of  carrying  out  such  an  integration  still  remains,  However,  for 
any  particular  problem,  one  can  employ  numerical  procedures  to  yield 
an  answer,  Another  possibility  which  has  not  been  considered  in  the 
literature  is  to  obtain  a  lows  r  bound  for  R(B„  X)  in  terms  of  known 
functions.  Further  work  in  this  area  is  required, 

3.  CONFIDENCE  INTERVALS.  The  problem  of  obtaining  confidence 
intervals  for  the  g  or  R  functions  is  considered  next.  The  general 
method  is  discussed  in  (,3J,  and  is  now  extended  to  the  regression  model. 
In  Section  4,  three  estimates  were  presented.  For  only  the  second  pro¬ 
cedure  is  the  distribution  theory  known,  so  that  exact  confidence  inter¬ 
vals  can  be  obtained.  However,  the  first  procedure  does  lead  to  approxi¬ 
mate  or  asymptotic  intervals  based  on  the  normal  distribution. 

"  2 

5.1  Exact  Confidence  Intervals.  Since  R((3,  <r  )  is  a  monotone 
function  of  K(p7o'),  if  we  can  find  a  confidence  interval  (K^,  K^)  for  K; 

we  will  then  have  a  confidence  interval  (R  ,  R  )  for  R,  where 

X  fit 


Ri 3  3  (2ff)  l/c  ^(-yV2)  dy- 


It  is  shown  in  Appendix  A  that  K(j3,  (r)/||a|  s  t(f,  6),  where|aK  ^  ■ 

c'jXX')  c,  has  a  non-central  t -distribution  with  f  =  n  -  m  degrees  of 

it 6 6 do  hi  and  non -cent rsiity  ps.r&rnc  te  r . 
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.  6  =Iy^°'>-  c'P)/(<rj|a||)  =  K(p,  (r)/J|a  ||  , 

Thus,  a  lower  and  upper  confidence  limit  with  confidence  coefficient 
1  -  a  may  be  obtained  by  finding  the  values  of  6^  for  which 


(11)  P{t  >  -  y  ajj^~  I  f*  "  °i*  1  “  2<  where  =  1  -  a/2,  and 

a/2.  Table  IV  in  CO  may  be  used  to  obtain  6^  for  seventeen  values 
of  «  . 

The  tabulation  by  Resnikoff  and  Lieberman  [6]  of  the  percentage  points 
of  the  non-central  t- statistic  may  be  conveniently  used  to  obtain  the  limits 
6  and  6  that  satisfy  (11),  The  entries  in  the  table  give  the  values  of 
x  such  that 

p(<f  >  *3  ■  *  ■ 


The  table  should  be  entered  for  the  degrees  of  freedom  f  *  n-m,  the 
probability  corresponding  to  c^,  and  x  ■  K(fJ,'3')/({ja||',ff)  .  The 

required  non-ccntrality  value  6^,  alff  +  1  K  ,  where  is  the  stand-  :■ 

ardiscd  normal  random  variable  exceeded  with  probability  p,  The  pre¬ 
sent  concern  was  with  one  sided  tails  (one  sided  specification  limits)  fdr 
both  the  univariate  and  multivariate  cases.  A  review  of  available  point 
and  confidence  methods  for  two  sided  tails  is  given  in  CO  *  '( 


5,  2  Approximate  Confidence  Intervals,  If  we  expand 


,fr2)  about 


R(0,ir  ),  we  obtain  the  result  that 


X 


nl‘ 3  m  a  _*•»  ir  in 

’roo\Ppu  It 


2m 


where 


Vw  (fJ,  ff)  s  r2  [n(y(C)jc'|3,  cr2)]  2  {c.'(XX')*1  c  +  ^  ---&■ 


l2i 
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Consequently  (see  Appendix  B), 

~  N(0,:  1) 


from  which  we  obtain  the  confidence  interval 

[R(0 ,*2)  +  za/z'(yjJ7T)  ,  R($,$Z)  +  a1_Q/2'>Hupr^)  ] 


where  is  the  lOO  a  %  point  of  the  N(0;  i)  distribution, 

6.  SAMPLE  PROBLEM.  In  order  to  illustrate  the  results  of  the 
previous  sections,  a  sample  problem  will  be  solved.  A  model  repre¬ 
senting  the  performance  of  a  hypothetical  shaped  charge  warhead  section 
for  a  missile  will  be  described,  and  the  performance  reliability  will  be 
evaluated  based  upon  a  Monte  Carlo  simulation  of  test  results.  The  point 
estimates  and  confidence  intervals  obtained  using  the  methods  previously 
described  will  be  compared  with  the  true  value  of  the  reliability.  Only 
the  univariate  or  independent  response  cases  are  considered.  * 

6.1  Performance  Model,  The  warhead  section  to  be  evaluated  con¬ 
sists  of  a  shaped  charge  warhead  and  a  Safety  and  Arming  Device.  It 
is  assumed  that  the  warhead  is  required  to  penetrate  at  least  lO  inches 
into  an  armor  plate  target  and  th&x  the  minimum  arming  time  of  the 
S  and  A  is  O,  5  seconds.  The  warhead  section  is  expected  to  meet  these 
performance  requirements  under  all  possible  combinations  of  vibration 
and  temperature  shock  that  may  be  encounterecl.  To  facilitate  the  illus¬ 
tration,  only  two  stresses  are  considered  in  this  problem,  but  the  pro¬ 
cedure  is  easily  extended  to  more  than  two  stress  variables. 

The  two  stresses,  vibration  in  g's  and  temperature  shock  in  stan¬ 
dard  cycles,  are  denoted  by  X^  and  X^,  respectively,  Coded  levels 

of  the  stresses  are  used  throughout  this  problem  to  facilitate  the  analysis 
and  simulation  of  test  results,  The  relationship  between  the  coded  and 
actual  stress  units  is  of  no  importance  with  regard  to  illustrating  the 
reliability  evaluation  methods  and  will  be  disregarded. 


484 


Design  of  Experiments 

The  critical  reliability  boundary  is  defined  by  the  vector 
c'  =  (c_,  c  c  )  where  c  ,  c  are  the  upper  stress  limits  specified 

U  1m  X  b 

for  vibration  and  temperature  shock,  respectively  and  c^,, ip  a  dumxyty 

variable  required  to  make  the  vector  c  consistent  with  the  design  ma¬ 
trix  X  and  is  equal  to  1.  The  coded  variables,  in  this  example,  are 
centered  on  the  critical  reliability  boundary  bo  that  c!  *  (i,  0,0). 


The  warhead  performance  1b  measured  in  terms  of  depth  of  pene¬ 
tration  t  into  monolithic  armor,  and  S  and  A  performance  is  measured 

by  arming  time  t^.  The  distribution  of  warhead  penetration  t^  and  arming 

time  t{  for  the  S  and  A  is  each  distributed  according  to  N 

cr^],  The  true  values  of  the  parameters  are 


fo _ Pj  h _ * 

Warhead  13"  -0,6  -0,4  1,5" 

S  and  A  O.  6  sec.  0,07  0,03  i  033  sec, 


These  models  thus  assume  that  the  average  penetration  decreases  linearly 
with  increasing  stress  and  that  the  average  arming  time  increases  very 
slowly  with  increased  stress  within  the  region  of  interest.  Thus,  by(J), 
wo  see  that  the  performance  reliability  for  the  warhead  and  8  and  A,  res¬ 
pectively,  are 

(12|  Rwhd  «  p{t^>  10")  *  r~  I  „<p,  „2>  d(<w0) 

10" 


=  Bl(c'p,  «r;  c)  2  8^13",  1.5"  ;  c)  *0,977 
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S  and  A 


*  P{t[0)2  O.  5}=  £  5  n(t({c)  |  c-p,<r2)  dt(fC) 


a  g1  (c'p,  <r;  c)  s  g,  (O.  6,  .  033  j  c)  »  O.  999 
The  performance  reliability  of  the  warhead  section  is  thus 


R  *  RWHD  ‘  RS  and  A  "  ‘  976  ’ 

Dud  probabilities  were  not  considered  in  this  model.  The  evalu¬ 
ation  of  dud  rates  requires  attribute  test  methods  which  are  not  as  effi¬ 
cient  as  the  variables  plans  and  require  much  larger  sample  sixes.  In 
conducting  the  type  of  test  program  described  herein  an  estimate  of  the 
dud  reliability  may  be  made  by  noting  the  number  of  dud  failures.  How¬ 
ever,  useful  interval  estimation  with  these  re  cults  may  not  be  possible 
with  reasonable  confidence  coefficients.  Whan  a  dud  occurs,  it  is  de¬ 
sirable  to  repeat  the  appropriate  test  under  the  same  conditions  in 
order  to  avoid  or  minimise  having  to  work  with  missing  data  in  the 
teat  plan. 

6,2.  Multiple  Regression  Analysis.  Multiple  linear  regression  ex¬ 
perimental  designs  of  the  type  used  In  exploring  response  surfaces  were 
used  to  evaluate  the  performance  reliability  of  the  warhead  and  S  and  A 
baaed  upon  the  stated  performance  model.  In  particular,  central  com¬ 
posite  rotatable  experimental  designs  [.3]  were  used.  The  experiments 
were  conducted  with  sample  sizes  (n)  of  8  and  30  for  both  the  warhead 
and  S  and  A.  The  treatment  combinations  and  the  responses  generated 
by  Monte  Carlo  simulation  of  the  performance  models  arc  shown  in 
Tables  i  to  4. 

t  ,s  _  •  .  ‘ 

Least  Souht**  of  the  regression  coefficients  and  vmur 

variance  were  made  for  the  test  results,  and  goodneBS-of-fit  tests  were 
conducted.  In  all  four  cases,  a  linear  regression  model  was  found  to 
represent  the  data  adequately.  The  least  squares  estimates  of  the  re¬ 
gression  coefficients  obtained  for  each  case  are  as  follows: 
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/V  /S  A 


Item 

n 

^O 

Pi 

P2 

Warhead 

T~ 

13,  99 

-.175 

,  675 

30 

12.  75 

-.  975 

,  21  5 

S  and  A 

8 

.  59 

.055 

.020 

30 

,  60 

,0705 

.0205 

Tests  of  significance  at  the  ,05  level  performed  for  the  regress¬ 
ion  coefficients  gave  the  following  results.  The  estimates  of  ^  and  (3^ 

for  the  warhead  based  on  n  =  8  were  not  significantly  different  from  aero. 
For  n  =  30,  ^  waa  not  significantly  different  from  zero,  but  which 

corresponds  to  the  effect  of  the  vibration  stress  X^  was  found  to  be  signi¬ 
ficantly  different  from  zero,  which  corresponds  to  the  true  situation  for 
the  model.  In  the  case  of  the  S  and  A, p  (temperature  shock)  was  not 
significantly  different  from  zero,  and  Z( vibration)  was  significantly 
different  from  zero  for  n=8  and  30, 

2 

Point  estimates  of  the  performance  reliability  R(p,  <r  )  at  c'o(l,0,0) 
were  made  using  the  UMVU  estimate  55( (i,  tr)  of  K(p,  er) .  Exact  one  sided 
lower  confidence  limits  using  the  non-central  t-distribution  were  also 
obtained,  A  summary  of  these  results  is  tabulated  below,  and  a  s-ample 
computation  is  given  in  Appendix  C  for  one  case,  Estimates  of  R(p,  tr 2) 
baaed  on  the  estimates  KyJ,  $)  and  K( (3,  or)  are  also  included  in  the  appendix, 


Case 

Item 

n 

| 

R(.  95) 

True  R 

1 

Warhead 

8 

.974 

,832 

.977 

2 

30 

.  967 

.  905 

3 

S  and  A 

8 

.983 

.  891 

-999 

4 

30 

/'  •  997 

,  981 

where  R  ^is  the  Estimate  of  Performance  Reliability  based  on  the  UMVU 
estimate  K(p,  <r)  or  K(b,  a)  and  R(,95)  is  the  one-sided  lower  95  con 
licence  limit  for  Performance  Reliability. 
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A  point  estimate  of  the  warhead  section. reliability  is  given  by 
R  a  RWHD  '  RS  and  A  ’ 


Conservative  .90  confidence  intervals  for  the  warhead  section  reliability 
are  obtained  by  multiplying  the  lower  .  95  confidence  limits  for  the  war¬ 
head  and  S  and  A,  This  result  is  easily  proven  by  applying  the  Bonferroni 
inequality  to  obtain  a  conservative  simultaneous  confidence  region  7 
for  R^ilD  *nd  Rg  ^  and  by  making  use  of  the  fact  that  the  product 

is  monotone  in  each  variable,  Thus,  we  obtain  the  following  results  for 
the  warhead  section  reliability. 


n 

_R 

R(  >  .  90) 

True  R 

8 

,957 

.741 

,976 

30 

.  964 

.  888 
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TABLE  1 
WARHEAD 

EXPERIMENTAL  DESIGN  Ng> 


flSmpla  *1 

1  *1 

2  4-1 

I  -1 

4  41 

5  0 

4  0 

7  0 

i  o 


■2 

I* 

-1 

13.3 

•  1 

14.9 

41 

16.4 

41 

14.3 

0 

11.6 

0 

11.7 

0 

12.1 

0 

14.3 

mi  •  ViferttlM 
«t  ■  TinptrituM  Shock 
■  PiMtrMioa  (Inch*  a) 
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TABLE  2 

WARHEAD  EXPERIMENTAL,  DESIGN  N»30 


Sample 

*2 

ll 

V 

1 

-i 

-1 

13.8 

2 

41 

-1 

12.  1 

3 

-1 

+  1 

13.8 

4 

+  1 

+  1 

12,7 

5 

0 

0 

12.  1 

6 

0 

0 

10.9 

7 

0 

0 

*2.5 

9 

0 

0 

12.2 

9 

•  1 

-1 

13,7 

10 

+1 

-1 

10.5 

11 

.1 

+  1 

12.7 

12 

+1 

41 

11. 0 

13 

0 

0 

14.8 

14 

-1 

-1 

13.7 

15 

+1 

-1 

9.5 

16 

.1 

+1 

11.5 

17 

+1 

+1 

13.0 

18 

0 

0 

13.3 

19 

.1 

•  1 

12.0 

20 

+1 

*  1 

'  12.5 

21 

-1 

+  t 

14.4 

22 

+1 

+  1 

11.4 

28 

0 

0 

13.9 

24 

.1 

-1 

14^8 

25 

+1 

.1 

11.5 

26 

-1 

+1 

15.6 

27 

+1 

+1 

14.3 

28 

0 

0 

12.0 

29 

0 

0 

16.0 

30 

A 

ar 

A 

1  ■»  *1 

xj  »  Vibration 

X2  “  Temperature  Shock 

tw  u  Penetration  (Inches) 


% 

V 

3 

i 

i 

I 

•3 


TABLE  3 


S  fc  A  EXPERIMENTAL  DESIGN  N«8 


Sample 

III 

He 

Arm  tug  Tim* 
(»*coad*) 

1 

-1 

0*1 

.48 

2 

41 

.1 

.43 

3 

-1 

41 

.54 

4 

41 

41 

.43 

5 

0 

0 

.61 

4 

0 

0 

.54 

7 

0 

0 

.40 

• 

0 

0 

.64 

*1  »  Vibration 

>2  "  Tomparatura  Shock 
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TABLE  4 

S  <i  A  EXPERIMENTAL  DESIGN  N-30 


Satnpla 

*1 

*2 

Arming  Tima 
(eaconda) 

i 

•  1 

•  55 

~i 

,? 

41 

-1 

.63 

3 

.1 

41 

.56 

4 

41 

41 

.71 

5 

0 

0 

.57 

6 

0 

0 

.68 

7 

0 

0 

.87 

1 

0 

0 

.60 

9 

-I 

-I 

.50 

10 

41 

-1 

.66 

11 

•  1 

41 

.53 

12 

41 

41 

.73 

13 

0 

0 

.57 

14 

•  1 

•  1 

.58 

15 

41 

.1 

.66 

14 

-1 

41 

.57 

17 

41 

41 

,72 

18 

0 

o 

.55 

19 

-1 

-1 

.46 

20 

41 

-1 

.64 

21 

•  1 

41 

.54 

22 

4 1 

41 

.65 

23 

0 

0 

,59 

24 

-1 

-1 

.51 

25 

41 

-1 

.67 

26 

-1 

41 

,56 

27 

41 

41 

.70 

23 

0 

0 

.53 

29 

0 

0 

.61 

30 

o 

o 

.60 

X]  *  Vibration 

X2  *  Temparature  Shock 


:iir je .’JSSKS'lMi'ffff  Sr  ¥?  ;t  ir  *•  J» t* «* Ssftffi!! «# If!* ?1  f  n* 


o 


CM 


,....,  un)  art  Independently  and  Identically  distributed  with  mean  ID 
and  variance  (X*. 

Figure  i 


appendix  a 

Define  K  -  (y^-  c'0)/cr  and  K(0,o)  -  (y^-  e'B)/p,  vte  first 

note  that  p  and  S  are  independently  distributed.  since  E@  -  p, 

v®  have  that  E(y^-  c'&)  -  (y(°K  e'p).  Also  v  *  has  a 

9 

distribution,  f  -  n  -  m,  bo  that 


-1/2 

"  6  ?(£) 


Hence, 


a  jS  i  ...  i 

Vf  riip)  9  0 

wtoloh  proves  that  K(P,g)  —  y-j-  K(p,o)  is  an  Unbiased  estimator 

yf  r(-r) 

of  K(0,a) .  By  completeness,  it  thin  follows  that  K  is  the  unique  such 
estimator,  and  hence  is  IftSVU, 

An  alternative  approach  is  also  useful,  namely,  that  K(p,o)/||a||  m  t(f,B) 
has  a  non-central  t-distribution  vith  f  degrees  of  freedom  and  non- 
centrality  parameter 


r(°).  e'f 


K(Pjg) 


whsrs  Hajj^  -  o'(XX')  To  see  thiB,  we  write 
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,  a  n  , 

K(P,<r) 


Thu*, 


y<°>-  o'ft 

VVarfc'lT) 

vWcT) 

A 

a 

vW(< 

m 

and  hence 

var(o'^)  i 

o'p' 

o'S-o'P 

dial!  ' 

o||a| 

l 

0 

...  4i  /  <*  »  \ 

•*  «V4  •/'«*/  ♦ 


Ry  noting  that  8t(f,6)  »  6  life,  r (rg^)/r{|)#  we  can  also  obtain 


B  K(foc)  -  K(M)< 


APPENDIX  B 


Since  la  a  function  of  the  sample  moment*,  it  follow* 

that  ia  aayruptptioally  normal  with  mean  B(B,c2)  and  varianoe 


i>  'V  *1  S5|  .W(82)  • 


SB 

*1**1 


The  aroaa-produot  tanas  involving  pi  and  $  drop  out  because  of 


A  aO 

the  independence  of  £  and  o  •  Prom 


R(b,e^)  ■  /  (2«)’^2  e*p(-l/2  t2)  dt  , 

(y<0)-  «’*>/• 


ve  obtain 
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Sr 

*1 


JO* 


1  (v^^-c'b^ 

exp  [  -1/ 2^  ZC  '—  ] , 


2  *  fl 


Sr 

57 


.  (y(Q)-cb) 


exP [ -  V '2 ~~y '  ~ )'  -] 


Also,  Cot(P1,{Jj)'«  a2  a^,  where  A  -  (XX* )"1,  Var($2)  -  2c i^/t,  and 
hence  the  aoyranptotic  variance  ia 

-  ^(n(y(0)  |  0'Pl  a2)]2  fc'(XX')"1  0  +  ^!°^|.,lPi2)  . 

But,  V'l^ja2)  Is  a  rational  function  of  the  sample  momenta,  ao  that, 
by  fllutaky'a  'Theorem,  V^P^S2)  converges  in  probability  to  V(B(P,o2), 
and  henae 


Apal:..Itt?,A.  _  n(0,  1)  . 

■  , 

APmmx  0. 

She  computation  of  the  point  and  oonfidence  interval  estimates  for 
the  performance  reliability  of  the  warhead  for  the  sample  alee  n  -  8 
ia  described  in  this  appendix.  From  the  test  data  in  liable  I,  we 
obtain  the  following  results; 

Point  Batlmation  ( 

¥  m  2.956,  eV»  (1»  0,  0),  f  «  n  -  m  =  8  -  3  -  5 


i 
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Substituting,  these  two  estimates  of  K(p,«r)  in 

R(p,a2)  -  /  (aK)"1/2e’y2/2  ay 

K(M) 

giyis  the  two  estimates  of  reliability  R(p,S)  and  ft(p,o)  » 
respeotively.  Thus, 

R(0,c)  -  /  ay  -  ,9898  ,  and 

-  2.320 

»0,o)  -  /  (2 ay  -  .974. 

-  1.95 

Confidence  intervals 

||a)|2  -  o' (XX')"^o  -  |  for  o'  -  (1,0,0).. 

Following  the  notation ! of  Resnikoff  and  Llebennan,  a  confidence 

Interval  say  be  obtained  using  the  non-oentral  t- tables  in  [6],  The 

percentage  points  of  t  are  denoted  by ,  »(f,fi,e)  where  x  is  the 

value  such  that  P  (~  >  x  |  f,6)  -  c  . 

•/} 

x  ■  £!ltsL  .  /j4.i|  -  «'!  (-2.320)  -  -  2.935. 

£  IM 

The  one  sided  lower  .95  confidence  limit  for  R  is  obtained  by 
finding  the  corresponding  limit  for  K(P,o)  because  of  the  monotone 
relation  between  R  and  Kip, a)-  The  l~cs  confidence  limit  for 
K(P,cr)  is  obtained  by  solving 


x(n  ■  Bj  8.  l-<x)  «»  ^ 

'  1  -or  y,  t.|| 


x<5,  &<95>  <95)  -  -  2.935  • 


Making  use  of  the  relation  x(f,B,«)  ■  -x(f,-8,l-e),  wo  obtain 


x(5jp  -6  95#  .05)  -  2.935  • 


From  the  Heanikoff-Lieberman  table  of  percentage  points  of  t,  we 


obtain  a  non-centrality  value  6  Vf  +  1  ■  /6  (1.107)  *  2.712 

by  interpolating  on  K  •  Since  8  ■  the  .95  lower  oonfi- 

,  T  11*11 

dance  limit  for  K(S,fl)  i» 


K(Pjo)  -  ||a(|  B  ob  -  ■  "  r.959 

.95  ,y5  v'  n  «  /  8 

Finally,  the  .95  confidence  limit  for  R  ia 


X  2 

R (P,0Z)  m  f  (s *)"  ^Vy  /a  dy  -  .832  . 

.95  K(p,a) 

•95 


8  may  also  be  oomputed  using  the  Johnaon-Welch  table  IV  and 

»7? 

following  the  procedure  on  page  372  of  t5]« 


EVALUATION  OF  VARIOUS  LABORATORY 
METHODS  FOR  DETERMINING  RELIABILITY 

A.  Bulfinch 

Reliability  Concepts  Section,  Reliability  Branch 
Quality  Assurance  Division 
Plcatinny  Arsenal 

ABSTRACT.  In  preparation  for  evaluating  several  laboratory  methods 
for  determining  reliability,  an  operational  definition  of  reliability  has  been 
described  in  terms  of  stress  and  strength.  The  definition  was  verified  by 
three  independent  methods  of  calculation. 

Two  classes  of  laboratory  methods  have  been  evaluated  by  means  of 
Monte  Carlo  Sampling  Procedures: 

1.,  Testing- Without-Failure 

2.  Testing-With-Failure 

The  former  type  was  found  to  be  worthless  or  of  limited  value.  The  latter 
type  was  found  to  be  capable  of  accurate  and  precise  determination  of  re¬ 
liability  values  at  any  level  with  small  sample  sizes. 

"  ‘  I” 

I,  INTRODUCTION.  This  investigation  is  concerned  with  the  labora¬ 
tory  determination  of  ultimate*  functional  reliability  with  respect  to  single 
environments  of  components  from  systems  to  be  used  only  once.  To  this 
end,  Mmte  Carlo  Experiments  have  been  conducted  to  evaluate  the  precision, 
accuracy,  and  efficiency  of  two  types  of  methods: 

1.  Methods  which  test-without-failure 

2.  Methods  which  te*t-to-failure, 

In  preparation  for  conducting  these  experiments,  consideration  was  first 
given  to  establishing  a  valid  procedure  for  calculating  the  true,  ultimate® 
reliability  of  known  conditions  from  the  operational  definition  of  reliability 

described  below.  ' 

II.  OPERATIONAL  DEFINITION  OF  RELIABILITY.  The  theoretical 
definition  of  reliability,  the  probability  of  success  under  specified  conditions, 
gives  no  clue  as  to  how  reliability  can  be  experimentally  determined.  This 


’’‘Ultimate  in  this  sense  means  maximum  or  unbiased  value, 
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question,  of  course,  must  be  answered  before  an  experiment  to  measure 
reliability  cap  be  conducted.  That  is,  the  theoretical  concept  of  reliability 
must  be  translated  into  an  operational  definition  in  terms  of  measurable 
properties  and  condition#;  The  following  procedure  is  proposed  as  such 
a  definition  of  the  true,  Ultimate  reliability  of  items  to  be  used  only  once. 

The  objective  of  the  procedure  is  to  measure  the  probability  of  failure*  - 
the  complement  of  the  probability  of  success. 

The  concept  of  reliability  can  be  thought  of  in  terms  of  stress  and 
strength.  *  The  relationship  between  these  two  elements  can  be  represented 
graphically  by  two  distributions  on  a  single  continuous  scale:  one  (on  the 
left)  for  the  specified  condition  which  will  be  called  the  applied  stress  curve 
and  the  other  (on  the  right)  for  the  property  of  an  item  which  will  be  called 
the  strength  curve.  The  distance  between  the  means  of  these  distributions 
represents  the  margin  of  safety,  or  the  extra  strength  built  into  the  item 
during  development.  If  the  mean  stress  equals  the  mean  strength,  then 
the  two  curves  are  superimposed  and  the  reliability  is  equal  to  50%, 

It  is  reasonable  to  assume  that  an  item  will  not  fail  unless  the  applied 
stress  equals  or  exceeds  the  item's  strength.  Referring  to  the  two  dis¬ 
tributions  described  above,  the  probability  of  a  strength,  less  than 
any  particular  stress  value  can  be  measured  by  the  area  under  th, jit  portion 
of  the  strength  curve  which  represents  items  with  strengths  less  than  that 
stress--that  is,  the  area  of  the  strength  curve  to  the  left  of  the  stress  ordin¬ 
ate.  The  probability  of  a  particular  stress  value  occurring  cart  be  measured 
by  a  small  increment  of  area  between  two  ordinates  on  the  stress  curve. 

In  order  to  produce  a  failure  in  this  manner,  the  higher  stress  value  must 
occur  simultaneously  with  the  lower  "Strength  value.  To  determine  the 
probability  of  such  a  combination  of  independent  events  occurring,  the 
product  of  the  probabilities  of  the  separate  events  occurring  must  be  ob¬ 
tained,  There  are  many  such  mutually  exclusive  combinations  possible. 

To  obtain  the  total  probability  of  failure,  the  sum  of  all  the  possible  pro¬ 
duct  must  be  calculated. 

Defining  the  complement  of  rpli»hi]ity  in  this  manner  appear 2  to  be 
logically  sound.  The  mathematics  involved  is  based  on  well-known  laws 
of  probability.  Therefore,  the  complement  of  the  sum  of  the  products  of 
the  probabilities  of  the  stress  equaling  or  exceeding  the  strength  can  be 


ijc 

Strength  here  means  the  ability  to  withstand  environmental  stresses. 
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taken  as  the  operational  definition  of  the  true,  ultimate  reliability  of  items 
used  only  once. 

It  would  appear  that  combinations  of  conditions  of  this  kind  can  repre¬ 
sent,  in  an  elementary  way,  the  cause  of  failure  when  a  component  experi¬ 
ences  an  environment  in  actual  use.  A  reliability  obtained  in  this  manner 
then  has  practical  value  and  c=n  be  accepted  cc  the  ovlution  to  the  basic 
problem  of  obtaining  a  valid,  unbiased  numerical  value  for  reliability. 

III.  VERIFICATION  OF  THE  OPERATIONAL  DEFINITION. 

A.  Numerical  Integration: 

Having  arrived  at  these  conclusions  the  following  combination 
of  conditions  was  chosen  for  use: 


Stress  Uj  ■  10  (True  average  stress) 

Sj  ■  5  (True  std.  dev.  of  stress) 

Strength  U2  ■  20 (True  average  strength) 

S2  ■  5  (True  std.  dev.  of  strength) 

Both  distributions  were  assumed  to  be  normal. 


fe 


The  reliability  associated  with  this  condition  was  calculated  by  the 
numerical  integration  procedure  (calculating  the  sum  of  products)  des¬ 
cribed  above.  The  following  results  were  obtained: 

STRESS  INCREMENT  RELIABILITY 

1.  0  Unit  .  0362 

0.  5  Unit  .  9264 


B,  Modified  Normal  Deviate: 

A  second  method  of  determining  the  reliability  value  for  the 
above  condition  which  has  its  foundation  for  validity  in  statistical  theory, 
is  the  following  formula  suggested  by  Dr.  William  S.  Connor  of  the 
Research  Triangle  Institute: 
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Z  = 


-  X2)  -  (Uj  -  u2) 


2+  s22 


v 

A  failure  cati  occur  only  when  Xj  £  X^,  where  Xj  is  any  stress  value 
and  X2  is  any  strength  value.  For  this  situation  the  formula  becomes; 


Substituting  the  above  values  assigned  +0  Uj,  u2<  Sp  and  Sg: 

II 

v§!K  "!S  ■  vw " L  414 


Entering  a  table  of  areas  under  the  standard  normal  curve,  the 
following  value  can  be  obtained. 


R  £  0,9213 


C.  Monte  Carlo  Sampling! 

A  third  method  of  determining  the  reliability  value  for  the  above 
condition  ie  the  Monte  Carlo  sampling  of  both  distributions.  This  method 
is  acceptable  as  valid  on  reasonable  and  logical  grounds  also.  The  stress- 
strength  combinations  that  occyr  in  actual  use -conditions  result  from  a 
random  selection  of  such  combinations.  This  is  the  basis  of  the  Monte 
Carlo  procedure  described  below  which  will  be  called  the  Flight-Condition 
Procedure. 
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chosen  at  random  from  their  respective  distributions  by  means  of  tables 
of  random  normal  numbers  from  these  distributions.  The  values  in  each 


pair  were  compared  to  determine  whether  the  stress  exceeded  the  strength. 
In  those  cases  where  this  was  true,  the  result  of  the  observation  was  de¬ 
clared  a  failure. 
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The  average  reliability  value  obtained  from  7,  500  observations  with 
the  Flight  •’Condition  Procedure  was  found  to  be  R  ■  0.  9221. 

D.  Summary  of  Results: 


- - - — — - - 

Method 

1 

Reliability 

Numerical  Integration 

0.9264 

Z-Formula 

0.  9213 

Monte  Carlo  Sampling  (Flight-Condition 
Simulation) 

C.  9221 

Grand  Average 

0,  9233 

E.  Conclusions  of  the  Verification: 

The  close  agreement  of  the  values  obtained  by  these  three  in¬ 
dependent  methods,  each  of  which  can  be  separately  accepted  as  valid, 
is  considered  ample  justification  for  concluding  that: 

1.  The  operational  definition  of  reliability  described  above  can  be 
taken  as  valid, 

2.  The  true-ultimate  reliability  for  the  condition  described  abdve  is 
very  close  to  the  average  of  these  three  values:  0,  9233, 

3.  The  results  obtained  by  the  2-Formula  are  sufficiently  accurate 
to  justify  using  this  formula  as  the  primary  standard  procedure  for  cal¬ 
culating  the  reliability  of  "one*  shot"  items  under  the  above  operational 
definition  of  reliability. 


IV.  EVALUATION  OF  LABORATORY  METHODS.  - 


A.  Introduction: 
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used  to  calculate  the  true -ultimate  reliability  values  for  the  known  stress  - 
strength  conditions  used  in  the  Monte  Garin  Experiments  that  follow. 

These  reliability  values  were  used  to  compare  with  estimates  obtained  from 
the  several  laboratory  methods  being  evaluated.  The  magnitude  of  the 
differences  found  between  the  true  and  estimated  values  were  used  to 
evaluate  the  accuracy  of  the  results  obtained  from  these  methods. 
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The  purpose  of  the  Monte  Carlo  Experiments  is  to  determine  the 
accuracy,  precision,  and  efficiency  of  various  laboratory  methods.  This 
is  done  by  Monte  Carlo  sampling  of  known  distributions  of  stress  and 
strength  combinations, 

B.  Testing- Without -B^ailu re  Procedures: 

1,  Single  Stress  Level  Method: 

In  practice,  this  method  consists  of  applying  the  same  en¬ 
vironmental  stress  level  to  each  test  specimen  comprising  the  sample 
and  counting  the  number  of  failures  obtained.  The  level  of  stress  applied 
is  usually  one  expected  to  be  experienced  In  use.  In  the  Monte  Carlo 
Experiment,  this  method  could  produce  a  failure  only  when  the  value  ob¬ 
tained  from  a  '.able  of  random  numbers  was  found  to  be  equal  to  or  less 
than  t,he  assumed  stress  value.  The  combination  of  conditions  used  for 
this  experiment  is: 


Stress 

Strength 

U  *  10 

U2  -  20 

S  ■  5 

1 

S2  -  5 

In  conducting  this  Monte  Carlo  Experiment,  the  following  assumpt¬ 
ions  were  made: 

(1)  The  stress  being  applied  was  10  units, 

(2)  The  tabled  values  of  random  numbers  used  contained  a 
decimal  point  to  the  left  of  the  first  digit  and  that,  as  such,  these  deci¬ 
mal  values  represent  the  probability  associated  with  the  strength  values 
used. 

(3$  A  failure  was  obtained  only  when  a  tabled  value  was 
found  to  be  less  than  u.  U2ZtJ  “  tne  probability  of  a  strength  value  equal 
to  or  less  than  10  units. 

Sample  sizes  of  22,  35,  45,  and  230,  were  used.  One  hundred  sam 
pies  of  each  size  were  taken.  The  purpose  here  is  to  determine  the 
effect  of  increasing  the  sample  size  in  addtion  to  the  purpose  stated 
above. 
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a.  Results: 


TABLE  I 

SINGLE  STRESS  LEVfcL  METHOD 
True  Probability  of  Failure  ■  0,  0787 
Sample  Size  *  22 


No. 

Failures 

Proportion 

Frequency,  Per  cent 

0 

0, 000  Moda 

73 

1 

.  045 

23 

2 

,  081 

4 

For  :  0/20  :  90%(1  -  aided)  upper  limit  for  defects  ■  .  039. 

The  true  probability  of  failure  la  Included  In  the  80ft  one-aided  upper 
confidence  limit. 
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TABLE  H 

SINGLE  STRESS  LEVEL  METHOD 
True  Probability  Of  Failure  =  0.  0787 


Sample  Size 

*  35 

Failures 

No, 

Proportion 

Frequency,  Per  cent 

0 

0.000  Mode 

57 

1 

.  029 

35 

2 

.087 

7 

3 

,088 

1 

For  0/35  t,  90%  (l  -  sided)  upper  limit  for  defects  ■  ,  083 
95%  (1  -  Sided)  upper  limit  for  defects  *  .  082 


The  true  value  is  included  in  only  the  95%  upper  limit. 
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TABLE  HI 

SINGLE  STRESS  LEVEL  METHOD 
True  Probability  of  Failure  a  0.  07B7 
Sample  Size  B  45 


No. 

Failures 

Proportion 

Frequency,  Per  cent 

0 

0, 000  Mode 

so 

1 

.022 

66 

2 

.044 

14 

For  0/45:  90%  <1  -  aided)  upper  limit  for  defects  ■  ,  049 


96%  <1  -  sided)  upper  limit  for  defects  «  .  064 
96%  <1  -  sided)  upper  limit  for  defects  ■  .  097 
The  true  value  is  included  in  only  the  99%  upper  limit. 
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TABLE  IV 

SINGLE  STRESS  LEVEL  METHOD 
True  Probability  of  Failure  »  0,  0787 
Sample  Size  ?  230 


Failures 

No. 

Proportion 

Frequency,  Per  cent 

0 

0.  000 

0 

1 

.  004 

4 

2 

,  008  8O%(2-0ided)  lower  limit 

10 

3 

.013 

7 

4 

.  017  Mode 

21 

5 

.  022 

17 

8 

.026 

14 

7 

,030 

11 

8 

.  035  80%<2-sided)  upper  limit 

7 

8 

,  039 

4 

1° 

.043 

4 

U 

.048 

0 

12 

.  052 

0 

13 

.  056 

1 

4/230;,.  99,  5%  (l  -  sided)  upper  limit  for  defects  =  ,  053 
The  true  value  is  not  included  in  even  the  99;  5%  upper  limit; 


3 

t 
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TABLE  V 
SUMMARY 

SINGLE  3TRE3S  LEVEL  METHOD 
Truu  Probability  of  Failure:  P  a  0,  0787 
True  Reliability:  R»  0.9213 

EFFECT  OF  SAMPLE  SIZE 


Sample  Stize 

Average 

R  P 

22 

.  987 

.013 

35 

.985 

.  015 

45 

.986 

.  014 

230 

.077 

,023 

b.  Conclusions: 

The  following  conclusions  can  be  drawn  from  the  above 
data  about  the  method  which  applies  a  single  stress  level  under  the  use 
conditions: 

(1)  This  method  produces  biased  results. 

(2)  IncrnaHing  the  snmnlp  aitp  did  not  remove  the  bias  sr  error. 

(3)  The  confidence  interval  is  worthless  for  locating  the  true  value, 

(4)  The  ultimate  value  of  the  failure  rate  being  measured  by  this 
method  is  0.  0228,  the  probability  of  a  strength  value  equal  to  or  less  than 
10  units  -  not  the  true  probability  of  failure  as  previously  defined. 
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(5)  The  possibility  of  a  stress  value  exceeding  a  strength  value  greater 
than  10  units  is  completely  ignored  by  this  method, 

(S)  This  method  is  worthless  to  determine  reliability  as  defined  above. 

2,  Multiple-Stress  Level  Method: 

The  flight- condition  procedure  used  earlier  as  one  of  the  in¬ 
tuitively  acceptable  basic  procedures  for  determining  true  reliability,  is 
one  which  also  readily  lends  Itself  to  laboratory  use  with  small  samples. 
For  this  purpose,  a  different  randomly  selected  stress  is  used  for  each 
test  specimen. 

a.  Results: 

Using  the  Flight-Condition  Procedure  in  the  Monte  Carlo 
Experiment  with  sample  size  of  50,  the  following  results  ware  obtained: 
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TABLE  VI 

MULTIPLE  -  STRESS  LEVEL  METHOD 
(Low  Reliability) 


Condition: 

STRESS 

STRENGTH 

Uj  *  io 

U  ■ 
2 

20 

S1  -  6 

S2  “ 

5 

True  Reliability 

»  0.  9213 

Sample  Size 

*  50 

DISTRIBUTION  OF  FAILURES  FOR  SAMPLES 

5f~50  ~ 


Number  of 

Failures 

Frequency 

0 

2 

1 

8 

2 

28 

3 

27 

4 

39  Mode 

5 

26 

6 

11 

7 

5 

8 

4 

6 

3 

Total  Number  of  Sample  Results: 

150 

Average  Reliability  «  0,  9224 
Standard  Deviation  =  0.  0376 
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TABLE  VII 

MULTIPLE  -  STRESS  LEVEL  METHOD 
(High  Reliability) 

Condition:  STRESS  STRENGTH 

Uj  »  10  u2 »  30 

Sj  "  8  S2  “  5 


True  Reliability  -  0,  B877 
Sample  Size  ■  50 

DISTRIBUTION  OF  FAILURES  FOB  SAMPLES  QF  50 


Number  of 

Failures 

Frequency 

t 

0 

90  Mode 

1 

9 

2 

1 

3 

0 

Total  Number  of  Sample  Results 

1P0 

Average  Reliability  ■  0,  9978 
Standard  Deviation  *  0.  0089 
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b.  Conclusions:  I 

■  ..  | 

Again  the  Flight-Condition  Procedure  produced  an  accu-  f 

rate,  unbiased  average  value.  However,  in  the  case  of  high  reliability,  | 

this  procedure  produced  no  failures  in  90%  of  the  samples  of  50.  In  addi¬ 
tion;  no  results  could  be  obtained  between  1,  00  end  .  98,  This  is  a  dis-  i 

tinct  disadvantage.  In  practice  only  one  small  sample  is  usually  taken.  s 

If  no  failures  are  obtained,  the  result  is  not  only  biased  but  it  is  worthless 
for  mathematical  manipulations  of  any  kind.  From  this  it  is  concluded 
that  testing  under  the  expected  stress  conditions  leaves  something  to  be 
desired  in  determining  high  reliabilities.  This  type  of  method  Is  too  in¬ 
sensitive  to  changes  in  high  reliabilities  to  be  of  use  with  small  samples. 

V.  TESTING -TO-FAlLtJRB  PROCEDURES. 

A.  Introduction: 

An  alternative  approach  for  determining  reliability  is  "Testing- 
to-Failure".  Instead  of  applying  the  stress  or  stresses  expected  in  use, 
system stically  increase  the  level  of  severity  of  the  stress  until  failure 
occurs.  Methods  for  this  purpose  are  available  which  will  generate  the 
ultimate  strength  distribution.  From  the  results  of  this  type  of  testing, 
the  average  and  standard  deviation  of  the  ultimate  strength  can  be  deter¬ 
mined.  By  means  of  Independent  experiments  or  prior  knowledge,  the 
average  and  standard  deviation  of  the  expected  stress  distribution  con  be  ! 

obtained. 

l.  T- Formula: 

With  these  two  sets  of  data  available,  reliability,  as  pre¬ 
viously  defined,  can  be  estimated  from  the  Z -Formula  by  replacing  the 
population  means  and  variances  with  their  sample  estimates:  j 
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X_  “  Observed  Average  Ultimate  Strength 
& 


X,  =  Observed  Average  Expected  Stress 


s^  3  Observed  Variance  of  the  Expected  Stress 


s2  *  Observed  Variance  of  the  Ultimate  Strength. 


Using  tables  of  areas  under  the  normal  curve  to  obtain  reliability 
values  from  the  T-Formula  for  samples  as  small  as  20,  causes  an  error 
in  the  result.  However,  this  error  is  small  --  less  than  one  per  cent. 

2.  Need  for  Indirect  Methods: 

Testing-to-Fsllure  Procedures  can  be  easily  performed  when 
the  measure  of  a  simple  property,  such  as  tensile  strength,  is  required. 

This  is  the  ideal  situation  in  which; 

a.  The  occurrence  of  a  failure  can  be  detected  by  visual  j 

inspection.  j 

b.  The  magnitude  of  the  applied  stress,  at  the  point  of  fail¬ 
ure,  is  directly  observable. 

The  results  obtained  in  a  test  of  this  kind,  permit  the  calculation  of 
the  average  and  variance  of  the  ultimate  strength  directly  from  the  ob¬ 
served  data,  These  values  can  then  be  used  in  the  T-Formula  to  cal¬ 
culate  the  reliability  with  respect  to  tensile  load. 

To  measure  more  complicat  ed  properties,  such  as  the  integrity  of 
a  moisture  seal  after  vibration,  indirect  methods  must  be  used  to  obtain 
the  average  and  variance  of  the  ultimate  strength.  In  this  case:  j 

a.  The  occurrence  of  a  failure  cannot  be  detected  by  visual  j 

inspection.  A  failure  must  be  determined  by  means  of  the  results  obtained  I 

from  conducting  an  appropriate  test.  I 

I 

"  1 
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b.  The  magnitude  of  the  stress  at  the  point  of  failure  is  not 
directly  observable.  The  stress  at  the  point  of  failure  must  be  calculated. 

The  observed  data  in  this  kind  of  test  is  simply  success  or  failure. 

As  the  stress  is  applied  at  higher  and  higher  levels,  higher  and  higher 
proportions  of  the  test  specimen  will  fail.  If  the  stress  is  increased 
step-wise,  and  the  proportion  of  failures  determined  at  several  points  be¬ 
tween  0  and  100%  failure,  the  familiar  sigmoid- curve  of  a  cumulative 
frequency  distribution  can  be  obtained  from  these  results. 

The  average  and  variance  of  the  ultimata  strength  can  be  determined 
from  this  curve.  The  average  value  is  the  stress  level  causing  50% 
failures.  The  variance  is  the  square  of  the  reciprocal  of  the  slope  of 
this  curve  at  the  50%  point. 

3.  Characteristics  of  Available  Methods: 

The  class  of  methods  that  can  generate  curves  of  this  type 
are  called  Tests -of-Increased  Severity.  Some  of  these  methods  are: 

|l 

a.  The  Hun-Down 

b.  The  Two-Stimuli 

c.  The  Up-and-Down 

The  Run-Down  Method  can  be  used, to  determine  the  shape  of  the 
sigmoid-curve.  But,  it  requires  the  largest  number  of  test  specimens. 

The  'IWo-Stimuli  Method  requires  the  assumption  of  normality. 

It  is: 

a.  An  abreviated  Run-Down  Method 

b.  Highly  efficient  when  the  above  assumption  is  valid,  since 
it  takes  a  minimum  number  of  test  specimens 

!,i!  ' 

c.  Easy  to  conduct 


d.  Easy  to  calculate  the  average  and  variance. 


The  Up-And-Down  Method  is  highly  efficient  for  determining  the 
50%  point.  However,  it  gives  a  poor  estimate  of  the  variance  without 
large  sample  sizes.  In  addition,  this  method  is  difficult  to  conduct  and 


rSQui Tea  lengthy  grouped  data  OalOulaiiOna  iu  Obtain  the  average  and 


variance. 
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4.  Two  -Stimuli  vs  Up- And -Down  Method: 

In  view  of  these  characteristics  and  the  following  data,  the 
Two-Stimuli  Method  was  chosen  for  conducting  most  of  the  initial  work  on 
this  class  of  methods. 


a.  Results: 


TABLE  VIII 


Conditions  Used: 


Test-to-Failure  Procedures 
STRESS  STRENGTH 


ux  -  10 


(True  averages) 


S  -  5 
l 

True  Reliability  «  .  9213 


3  »  5  (True  standard 
^  deviations) 


METHOD 

TOTAL  ND. 
OF  TRIALS 

AVG.  . 

Standard 

DEVIATION 

RELIABILITY 

Up-and-Down 

2700 

19,  8 

4.88 

.9197 

Two-Stimuli 

1000 

20.  0 

5.03 

.9207 

b.  Conclusions:  ■  ;; 

Any  observed  differences  in  the  averages  or  standard  deviations 
are  highly  significant  for  these  large  sample?  sises.  Therefore,  basing 
a  choice  on  the  absolute  magnitude  of  the  observed  differences,  it  can  be 
said  that  the  Two-Stimuli  Method  is  slightly  more  accurate  and  precise 
than  the  Up-and-Down  Method. 

B.  Two-Stimuli  Method: 

1.  Description: 

The  Two-Stimuli  Method  was  conducted  as  follows: 

Starting  at  an  assumed  stress  value  of  10  units,  the 
first  tabled  value  (converted  to  a  decimal  by  placing  a  decimal  point  to  the 
left  of  the  first  digit)  was  compared  to  .  0228.  If  the  tabled  value  wan  found 
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to  be  greater  than  ,  0228,  the  result  was  declared  a  success.  Then  a 
second  tabled  value  (as  a  decimal)  was  chosen  and  compared  to  .  0668,  the 
probability  value  associated  with  a  stress  of  12.  5  units.  If  the  tabled  value 
was  greater  than  ,  0668,  the  result  was  again  declared  a  success.  Then  a 
third  tabled  value  was  compared  with ...  1587,  the  probability  associated 
with  a  stress  of  15  units.  This  process  was  continued  using  inurements  of 
stress  equal  to  s^/2,  until  the  tabled  value  (as  a  decimal)  was  found  to  be 

equal  to  or  less  than  the  probability  value  associated  with  the  assumed 
stress.  When  such  a  comparison  was  found,  the  result  was  declared  a 
failure.  Only  half  of  the  cases  of  exact  equality  were  declared  failures. 

At  this  level  of  stress,  16  additional  c/baervations  were  made  by  the  com' 
parison  process  just  described.  The  proportion  of  failures  at  thisTevel 
of  stress  was  calculated  and  recorded,  If  this  proportion  was  less  than 
60%,  then  the  stress  level  was  increased  by  two  or  three  increments,  If 
the  proportion  of  failures  was  greater  than  50%,  then  the  stress  level  was 
decreased  by  two  or  three  increments.  A  total  of  20  observations  was 
made,  as  before,  at  this  latter  stress  level;  the  proportion  of  failures 
calculated  and  the  result  recorded.  Only  proportions  greater  than  0  and 
less  than  100%,  and  which  differ  by  20%  or  more,  are  useful  for  this  pur¬ 
pose.  The  average  and  standard  deviation  of  the  strength  curve  was  cal¬ 
culated  from  these  two  failure  proportions  by  means  of  the  equation  for 
the  standard  normal  cumulative  frequency  curve, 

2.  Results: 

The  following  results  were  obtained  using  the  Two-Stimuli 

Method: 
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TABLE  IX 

TWO -STIMULI  METHOD 
(Low  Reliability) 

Condition:  STRESS  STRENGTH 

U.  ■  10  U.  »  20 

1  « 

9  "  5  S_  "  5 

1  2 

True  Reliability  ■  0,9213 
Sample  Size  -  45 


^DISTRIBUTION  OF  RESULTS  FROM  SAMPLES  OF  48 


Reliability  Frequency 

Cell  -  Width 

.980-.  070 

.989-.  950  17 

.949-,  930  42  Mode 

.  929-.  910  25 

.908-.  800  32 

.889-.  870  14 

,  889-.  800  12 

.849-,  830  3 

.829-.  810  1 

.  809-.  790  '  3 

,  789-.  770  _ _ 1_ 

Total  Number  Of  Sample  Results  150 


Average  Reliability  *  0.  9136 
Standard  Deviation  =  0,  0369 
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TWO- STIMULI  METHOD 
(High  Reliability)  : 

Condition:  STRESS  STRENGTH 

Uj  *  10  U2  ■  30 

3,  -  6  S2»  5 

True  Reliability  ■  .  9077  Sample  Size  »  45 


DISTRIBUTION  OF  RESULTS  FROM  SAMPLES  OP  45 


Reliability 

Cell -Width 

Frequency 

.  6990 

.  9698 

2 

.  8907 

-  .  0990 

41 

.  898 

-  .  905 

74  (Mode) 

.894 

-.091 

20 

. .  690 

-  .  987 

8 

.  088 

-.083 

"  2 

.982 

-.978 

0 

.978 

-.078 

1 

.074 

-.071 

O'  !! 

.970 

-.,007 

2  1' 

.  988 

-.083 

•  i  i 

.002 

850 

0 

.  958 

-  ,  6bd 

o 

.954 

-  .  050 

1 

TOTAL  NUMBER  OF  SAMPLE  RESULTS 

150 

Average  Reliability  =  o,  8952 
Standard  Deviation  =  0.  0064 
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3.  Conclusions: 

It  is  clear  from  the  above  results  that  estimates  of  reliabilities 
at  any  level  can  be  obtained  with  acceptable  accuracy  and  precision  from 
small  samples  when  using  the  Two-Stimuli  Method.  This  method  is  sensi¬ 
tive  to  changes  that  actually  take  place  in  either  Irrw  or  high  reliability  con¬ 
ditions,  In  principle  then,  this  type  of  method  is  the  solution  to  the  problem 
of  measuring  high  reliabilities  with  small  sample  sizes. 

VI.  SUMMARY: 

A.  Comparison  of  Testing-With-Failura  with  the  best  of  the  Testing- 
Without- Failure  Methods. 
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TABLE  XI 

1.  LOW  RELIABILITY 

Condition:  STRESS  STRENGTH 

U  «  10  U2  »  20 

S1  ■  8  Vs 

True  Reliability  =>  0,9213 


Sample  Size:  Two-Stimuli  Method,  N  ■  45 

Flight  Condition  Method,  N  ■  50 


DISTRIBUTION  RELIABILITY  RESULTS 

Reliability 

Cell  Midpoints 

Two-Stimuli 

Flight  Condition 

1. 00 

0 

2 

.98 

0 

A 

O 

.  96 

17 

28 

.04 

42  (Mode) 

27 

.82 

25 

30  (Mode) 

.00 

32 

25 

.88 

14 

11 

.86 

12 

'  5 

.  8  4" . 

3  - 

‘  4 

.82  ' 

1 

3 

.80 

3 

0 

.78 

1 

0 

Average  Reliability  ■ 

.0130 

.  9224 

Standard  Deviation  = 

•.  1,1 

.  0369 

.  0366 
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B.  Conclusions: 

There  is  little  to  choose  between  these  two  methods  for  reliability 
values  equal  to  or  less  than  .9213.  However,  for  reliability  values  as 
high  as  ,  9977,  the  Two-Stimuli  Method  appears  to  be  superior  for  practical 
use  when  numerical  values  for  reliability  are  required. 

It  can  be  seen  from  Table  X  that  the  Two-Stimuli  Method  never  pro¬ 
duces  a  result  of  1.  000  for  reliability.  This  is  in  contrast  to  the  Flight- 
Condition  Procedure  which  produced  a  reliability  value  of  1.  000  in  90% 
of  samples  of  50  (Table  VII).  Seventy-eight  percent  of  the  Two-Stimuli 
Method  results  are  within  i  0.  002  of  the  true  value  for  the  high  reliability 
condition.  In  the  Flight-Condition  Procedure,  no  result  can  be  obtained 
between  1,  000  and  .  9800  when  a  sample  size  of  50  is  used. 

VII,  CONCLUSIONS: 

1.  For  practical  engineering  purposes,  reliability  can  be  defined 
in  terms  of  stress  and  strength.  From  this,  three  simple  conclusions 
follow: 

a,  Reliability  is  created  by  the  strength  built  into  an  item, 

u.  Ail  lieu i  i;«i>uul  fall  uiii.ll  iiio  niionS  equals  or  exceeds  the  strength. 

c.  To  increase  the  reliability  above  50%,  the  strength  must  exceed 
the  stress. 

2.  Reliability  is  a  relative  property  that  dip  ends  upon  the  en¬ 
vironmental  stresses  to  be  experienced  (in  use).  To  state  a  numerical 
value  for  this  property  requires  a  careful  definition  of  the  expected 
stresses. 

3.  The  magnitude  of  a  reliability  value  docs  not  depend  upon  the 
number  of  items  tested.  Increasing  the  sample  size  can  only  improve  the 
precision  with  which  the  reliability  value  is  known,  This  improvement  can  / 
be  obtained  only  if  the  method  of  testing  produces  an  unbiased  estimate  of 
reliability. 

4r  Applying  only  a  single  level  <ja  Liie  eApw.ulwu  air«OB  iu  all  oi  the 
test  specimens  cannot  determine  reliability  at  any  level  with  an  acceptable 
degree  of  accuracy  and  precision. 

5.  Applying  a  different  randomly  chosen  stress  level,  from  the 
expected  stress  distribution,  to  each  test  specimen  used,  produces  un¬ 
biased  results  and  is  only  useful  for  determining  low  reliability  values. 
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This  procedure  cannot  determine  high  reliabilities  with  small  sample 
sizes  with  an  acceptable  degree  of  precision. 

6,  The  Two-Stimuli  Method  can  determine  reliability  at  any 
level  with  small  sample  sizes  with  an  acceptable  degree  of  accuracy  and 
precision, 


COMPUTER  SIMULATIONS  IN  RELIABILITY 


Jasper  Dowling 

U.  S.  Army  Munitions  Command,  Picatinny  Arsenal 

ABSTRACT.  The  troublesome  problems  of  calculating  a  realistic 
lower  confidence  limit  for  systems  reliability  from  component  results  and 
writing  algebraic  probability  expressions  for  complex  systems  have 
been  investigated.  Practical  Monte  Carlo  procedures  for  routine  use  of 
high  speed  computers  are  described.  Iterative  procedures  are  explained 
which  can: 

a,  Save  time  in  calculating  the  lower  confidence  limits  of  com- 
plex  systems, 

b,  Obtain  point  estimates  of  complex  systems  from  Boolean  ex¬ 
pressions  when  the  writing  of  algebraic  equations  is  too  difficult. 

INTRODUCTION  This  paper  deals  with  two  of  the  problem  areas 
encountered  In  obtaining  estimates  of  the  reliability  of  a  weapon  system 
from  component  test  data.  The  accuracy  of  the  reliability  estimate  of 
a  system  is  a  function  of  the  accuracies  of  the  component  reliability 
estimates.  The  calculation  of  the  lower  bound  of  the  system  estimate, 
or  lower  confidence  limit,  is  one  of  the  problem  areas  and  is  the  first 
of  the  two  discussed.  The  remainder  of  this  paper  explains  a  computer 
simulation  technique  for  evaluating  system  Boolean  expressions  where 
algebraic  probability  expressions  are  not  feasible. 

CONCLUSION, 

1.  It  is  concluded  that  the  Monte  Carlo  technique  is  a  valid  and 
practical  method  of  obtaining  the  lower  confidence  limit  of  a  system. 

A  90  %  lower  confidence  limit  of  O,  88  obtained  with  the  Monte  Carlo 
method  dorresponds  with  that  obtained  by  Garner  and  Vail  (Reference  2) 
using  a  three  component  system  in  a  series  configuration  with  component 
reliabilities  of  O.  96,  0.97,  and  0.99.  Their  957o  lower  confidence 
limit  of  O,  88  using  a  different  technique  corresponded  with  the  lowelt  limit 
of  O.  88  obtained  with  the  Monte  Carlo  method. 

2.  A  five  component  system  of  known  system  reliability  was  used  as 
a  standard  in  the  second  part  of  this  report.  The  reliability  of  this  known 
system  was  O,  98.  By  using  the  formula 

p  4  2  ~\l 

—  v  n 
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it  was  determined  with  95  assurance  that  a  Monte  Carlo  sample  size 
of  78,400  would  be  needed  to  obtain  values  of  0.98  +  ,0005.  The  ay  stem 
was  run  and  resultant  values  of  O.  9795  and  O.  9799  were  obtained.  .Al¬ 
though  this  is  only  an  example  it  is  concluded  that  the  application  of  the 
simulation  is  valid,  and  hence  the  procedure  is  a  practical,  useful  one. 

MAIN  DISCUSSION  ■ 

1.  To  begin  the  discussion  of  the  lower  confidence  limit  let  ua 
assume  a  three  component  system  in  a  series  configuration.  See 
Figure  1^,  These  components  are  assumed  to  be  independent.  This 
system  reliability  is  O.  96  x  O,  97  x  O.  99  s  O,  92  (to  two  decimal  places). 

In  this  example  each  success  ratio  and  hence,  each  binomial  probability 
distribution  is  depicted  for  a  sample  size  of  lOO.  By  using  the  btnoml&i 
probability  law  we  can  compute  a  90  %  lower  confidence  limit  for  each 
of  the  components,  as  O.  92,  0,94,  and  O.  96  respectively.  Their  pro¬ 
duct  O.  92  x  O.  94  x  O,  96  *  O.  83.  This  is  not  a  90  %  confidence  limit 
of  the  3ystem. 

2.  To  achieve  the  desired  system  distribution  a  Monte  Carlo 
technique  can  be  used  to  perform  the  product  of  the  three  component 
distributions.  The  probability  of  choosing  particular  value  from  the 
component  distribution  will  have  to  be  equalj  to  the  distribution's  prob¬ 
ability  (ordinate).  To  obtain  this  with  a  uniform  random  number  gener¬ 
ator,  the  three  component  binomial  distributions  are  put  into  cumula¬ 
tive  distributions,  See  Figure  2.  A  random  number  x,  O  <  x  <1  is 
generated,  If  this  random  number  is  less  than  the  first  value  on  the 
cumulative  distribution  (lowest  ordinate)  the  value  of  the  abscissa  at 
this  ordinate  is  assigned  to  the  value  of  this  component,  If  the  random 
number  is  greater  than  the  first  ordinate,  It  is  compared  to  the  second 
ordinate.  This  continues  until  an  ordinate  is  greater  than  the  random 
number,  The  corresponding  abscissa  is  assigned  the  value  of  the  com¬ 
ponent.  This  is  done  for  each  of  the  three,  components  and  the  three 
assigned  values  are  substituted  into  the  system  equation  and  the  equation 
solved.  This  is  one  point  of  the  system  distribution.  As  an  example, 
assume  the  three  random  numbers  .3321645,  .21684290,  and  .93164200 
are  chosen,  The  corresponding  reliabilities  would  be  0.95,  0.96,  1.0  . 
The  point  on  the  system  distribution  would  be  the  product  of  these  three 
or  O.  9120.  This  procedure  is  repeated  many  times  to  form  the  system 
distribution. 

*A11  figures  are  contained  in  the  appendix, 
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3,  Figure  3  is  the  system,  distribution  of  Figure  1,  This  distri¬ 
bution  is  based  on  5,  OQO  points  (repetitions  )  with  a  mean  of  O.  92,  a 
standard  deviation  of  0.026  and  a  90  %  lower  confidence  limit  of  O.  88. 
This  lower  confidence  limit  can  be  obtained  by  assuming  normality  and 
calculating  the  limit  or  by  counting  the  lowest  500  points  (10  %  of  the 
total)  of  the  system  frequency  distribution  . 

4.  Figure  4  represents  a  22  component  system,  Each  component 
is  represented  by  its  binomial  probability  distribution  based  on  a  sample 
sloe  of  1QO,  It  should  be  noted  that  although  there  are  a  number  of 
similar  components  to  be  assigned  the  same  probability,  the  algebraic 
equation  must  allow  for  22  independent  components.  Assigning  similar 
components  the  same  Monte  Carlo  or  simulated  value  will  cause  both 
higher  and  lower  system  values  and  hence  an  excessively  high  variance „ 
and  a  wider  frequency  distribution.  For  accuracy  in  counting  the  loweat 
cells  for  determining  a  counted  confidence  limit,  the  system  frequency 
distribution  is  collected  in  small  ceil  intervals  and  grouped  after  counting 

3.  Figure  5  is  the  system  distribution  of  Figure  4  based  on  5,000 
points.  The  mean  value  of  this  22  component  system  is  0,98  and  the 
lower  90%  confidence  limit  is  O.  97.  It  is  interesting  to  point  out  that 
this  distribution  looses  its  symmetry  as  the  sample  size  is  decreased. 

The  left  hand  tail  becomes  quite  long  and  tapered,  It  should  also  be  noted 
that  although  this  distribution  is  essentially  binomial,  the  sample  size 
of  the  distribution  becomes  obscured  in  the  formation  of  the  distribution. 

6.  The  second  phase  of  this  paper  will  be  devoted  to  procedures 
for  the  evaluation  of  a  system  where  the  algebraic  probability  expression 
is  not  available.  While  dependency  of  components  is  a  contributor  in 
making  the  algebraic  probability  expression  difficult,  a  Bystem  algebraic 
probability  expression  can  become  "not  feasible"  even  when  all  com1' 
ponents  maintain  their  independence.  Examples  of  situations  that  add  to 
the  complexity  of  a  system  probability  expression  are: 

a.  Mechanical  and  electrical  couplings 

b.  One  part  oi  a  system  lunctions  only  it  a  second  part  of  the 
system  iails 

c.  Multi  -option  channel  s . 
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7.  Consider  Figure  6.  Clearly  this  is  not  a  simple  series-  parallel 
diagram.  There  are  16  paths  of  success  through  this  diagram,  A^B^C^DjE^F^ 

etc.  To  write  this  as  a  system  of  J6  in  parallel  v/ould  require  a  consider¬ 
able  amount  of  algebra,  to  account  for  repeating  components  in  more  than 
one  of  the  16  success  paths.  One  approach  to  a  solution  to  this  problem  is 
to  redraw  the  diagram  in  a  simple  series-parallel  configuration,  See 
Figure  8.  The  trouble  with  this  diagram  is  that  there  are  twenty-four 
components  represented  where  actually  there  are  only  nineteen  physical 
components.  Thus,  the  twenty-four  components  are  not  independent  and 
in  order  to  represent  the  systenq  in  a  simple  series-parallel  configur¬ 
ation,  it  is  necessary  to  draw  the  same  component  mci'ffc'than  once.  This 
procedure  perhaps  lessens  the  algebra  required  to  write  an  algebraic 
probability  expression,  however,  it  would  be  preferable  to  consider  a 
technique  that  doesn't  require  indepencence  or  an  algebraic  equation. 

8.  The  basic  notation  and  concept  of  Boolean  algebra  ahould  be 
mentioned  at  this  time.  A  plus  sign  is  used  to  mean  "or",  and  a  dot  is 
used  to  mean  "and".  The  following  expressions  are  thus  introduced: 


1+1*1  1-1*1 

1+0=1  1-0=0 

0  +  1*1  0-1=0 

0+0*0  0-0*0 


9.  For  purposes  of  illustration  the  example  used  earlier  will  be 
used  again,  Consider  Figure  7.  The  procedure  is  as  follows;  Generate 
a  random  number  (RN)  from  a  uniform  distribution: 

If  RN  <  reliability  of  component  A,  assign  A  *  1 
If  RN  >  reliability  of  component  A,  assign  A  *  O. 

Components  B  and  C  are  treated  similarly,  now,  the  probability  ex¬ 
pression  in  Boolean  notation  is  P  *  A-  B-C  which  reads  P  =  A  and  B 
and  C.  In  order  for  P  to  be  a  "1"  all  three  components  must  be  "1" 
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The  probability  of  assigning  a  "l*'  to  a  component  is  the  success  ratio 
of  the  component.  Hence,  the  probability  of  assigning  all  three  component 
a  "l”  is  the  system's  probability  of  success. 

10,  From  Figure  8  the  following  expressions  for  different  groups  of 
components  (X)  can  be  obtained. 

xj  °  ^1  '  ®i  +  A2  ®2 

X2  -  Cj  •  (Dj  •  £i  t  D3  •  E2) 

X3.Ca'(Di.*1*»4..  B,) 

*4  ■  V  <X2  +  x3>  •  r! 

V  V  ®3  +  A2  '  ®4 

X6  .  (Cj  +  C4)  ■  (Fj  +  Ej  F.) 

PHOB  •  X4  4  (Xj  •  X6) 

11.  To  solve  this  final  expression  a  random  number  Is  generated 
and  compared  with  component  one,  Aj  ia  assigned  a  ,*Olt  or  **1** , 

This  process  continues  until  all  nineteen  (not  twenty-four)  components 
have  been  assigned  a  or  "L",  IMPORTANT!  when  A  ,  A  E., 

.1  m  i 

E^,  and  F^  are  assigned  a  value  they  are  assigned  the  same  value  every¬ 
where  they  appear,  Upon  solving,  will  be  a  "l"  or  "O".  The  prob¬ 
ability  of  success  of  the  system  can  be  represented  by 

n 

p  =— *  2  PROB  where  n  is  the  number  of  times  the  system  is 

n  1*1  1 


simulated 
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BIO  ASSAY:  THE  QUANT AL  RESPONSE  ASSAY 


H,  C.  Baiaon 

University  of  Illinois  College  of  Medicine 
I:  Chicago 


1,  INTRODUCTION,  In  many  instances  of  interest  in  medical 
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tain  substances  cannot  be  measured  directly  by  common  In  vitro 
chemical  or  physical  methods,  but  can  be  measured  (quantitated) 
only  in  terms  of  some  offset  they  evoke  in  a  living  test  subject,  - 
animal,  plant  or  microorganism. 


Substances  in  this  category  Include  many  hormones,  vitamins, 
pharmacologically  and  toxicologicaliy  active  substances,  anti* 
blotics,  and  Immunologically  active  substances,  -  vaccines,  toxins, 
toxoids,  antisera,  allergens,  etc.  Measurement  or  quantitative 
assessment  of  the  activity  of  such  substances  constitutes  the  sub¬ 
ject  matter  of  biological  assay. 


Design  of  biosstay  experiments  and  statistical  analysis  of  the 
resultant  data  involve  mainly  an  extension  of  principle®  and  pro¬ 
cedures  readily  available  in  standard  references  on  experimental 
design  and  statistical  analysis  with  major  emphasis  on  regression 
analysis  and  analysis  of  variance  with  or  without  transformation 
of  the  data  originally  recorded  in  conventional  units, 

11,  TYPES  OF  BIO  ASSAYS 


1.  O  n  a  basis  of  Intent:  On  the  basis  of  intent,  Moassays  can 
be  classified  in  one  of  two  main  groups,  -  absolute  or  compara¬ 
tive.  ,i 

Absolute  assays;  Absolute  assays  involve  an  attempt  to 
obtain  some  quantitative  measurement  that  can  be  expressed  in 
absolute  terms,  such  as  a  Minimal  Lethal  Dose  (MLD)  or,  Median 
Effective  Dor*  (ED  ,  LD  •  *}<>  V  Spr-h- attempts  are  based 

on  the  assumption  or  belief  that  some  such  absolute  value  exists 
and  that  universally  it  can  be  determined  with  adequate  precision. 
However,  the  absolute  potency  of  substance  X  for  "the  cat"  typi¬ 
cally  depends  on  just  which  cat  is  used  and,  unfortunately,  cats 
invariably  do  differ.  Laudable  though  the  goals  and  objectives 
may  be,  absolute  assays  of  biologically  active  substances,  with 


552 


Design  of  Experiments 
few  (if  any)  exceptions,  have  little  useful  quantitative  meaning. 

Comparative  assays:  Although  absolute  assays  seldom  if 
ever  yield  adequately  reproducable  results,  it  generally  is  possi¬ 
ble  to  achieve  experimental  quantitation  of  many  biologically 
active  substances  through  assessment  of  the  substance  of  interest 
(unknown)  in  direct  comparison  with  a  reference  substance  (stand¬ 
ard)  qualitatively  identical  or,  at  least,  similar  in  terms  of  the 
reoponse  evoked  in  the  test  subject  of  choice.  While  the  absolute 
potency  of  either  may  never  be  known,  the  comparative  or  rela¬ 
tive  activity  of  the  two  may  bn  assessed  and  the  biological  activity 
of  the  unknown  expressed  in  relation  to  that  of  the  standard  in 
terms  of  relative  potency,  -  whether  expressed  in  proportions, 
percentages  or  in  arbitrarily  defined  units,  By  using  &  common 
referenda  or  standard  Substance,  various  investigators  may  obtain 
quantitative  results  with  a  degree  of  comparability  adequate  for 
their  ndeds<  Such  relative  potency  estimates  are  subject  to  uncer¬ 
tainty  (experimental  error),  of  course,  but  ideally  thi*|  may  be 
kept  within  manageable  proportions,  It  is  this  innate  Element  of 
uncertainty  that  makes  bioassay  a  candidate  for  statistical  con¬ 
sideration. 

2,  On  the  basis  of  response!  On  the  baele  of  the  response 
evoked  in  the  teat  subjects  of  choice,  moat  bioaesays  may  be  date- 
gorised  into  one  of  the  following  types: 

Direct  assays;  In  these  the  response  in.  the  individual  teat 
subject  is  absolute  (live,  die;  response,  non- response  j  etc, )  and 
critical  (thresh-hold)  levels  of  the„assayed  material  are  determinate 
at  least  within  reasonable  limits.  Computations ncalhly involve 
calculation  of  means  and  ratios,  and  estimation  of  standard:  errors 
or  confidence  limits  of  such  statistics.  Example;  the  cat  aisay 
of  digitalis. 

Graded  response -parallel  line  assays;  In  these,  the 
response  in  the  individual  is  proportional  to  the  dose  of  test  sub¬ 
stance  administered  and  the  degree  of  response  is  experimentally 
determinable.  Typically,  the  degree  of  response  is  a  linear  func¬ 
tion  of  log-dose  and  the  dosage-response  regression  lines  of 
"Unknown"  and  "Standard"  will  be  parallel  denoting  identity  or 
similarity  of  action.  Statistical  analysis  involves  mainly  regres- 
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sion  analysis  and  analysis  of  variance.  With  proper  design 
(balanced  or  partially  balanced  factorial  assays),  analysis  can  be 
simplified  greatly  through  the  use  of  coefficients.  Example; 
assay  of  insulin  in  the  rabbit. 

Slope -ratio  a  e  says;  These  include  mainly  the  microbiolo¬ 
gical  assays,  a  group  of  rather  limited  general  interest  in  which 
the  degree  of  measurable  response  in  the  individual  probably  is 
absolute,  but  since  masses  of  test  subjects  (microorganisms)  are 
dealt  with,  the  total  response  measured,  as  density,  acid  forma¬ 
tion,  etc.,  approaches  a  continuous  function.  Statistical  analysis 
involves  multiple  regression  and  relative  potency  is  estimated 
from  the  ratio  of  the  partial  regression  coefficients.  Example; 
microbiological  assay  of  riboflavin. 

Quantal  response  assays;  In  these,  response  in  the  indi¬ 
vidual  test  subject  is  absolute  (frequently,  live  or  die)  but  the 
critical  dose  of  test  material  necessary  to  evoke  the  response  is 
not  directly  determinable,  Quantitation  is  achieved  through  the 
us«  of  groupe  of  test  subjects  and  determination  of  the  proportion 
responding  to  various  dosage  levels  of  "Unknown"  and  "Standard" 
test  products.  Following  suitable  transformation  of  the  data 
(probits,  angles,  etc, , )  response  typically  is  a  linear  function  of 
log  doss  and  statistical  analysis  is  essentially  similar  to  that 
employed  with  the  graded  response-parallel  lino  bioassays,  Ex¬ 
amples;  mouse-protective  potency  assays  of  typhoid,  pertussis  and 
rabiss  vaccines.  • 

111.  REQUIREMENTS  OF  A  VALID  BIOASSAY.  The  follow¬ 
ing  requirements  of  a  "valid"  bioassay  have  evolved  from  recom¬ 
mendations  originally  made  by.Quddum  (1)  with  modifications  made 
by  Bliss,  Finney,  and  others,  and  are  practically  universally 
accepted  by  students  of  bioassay,  Perhaps  the  word  "valid"  should 
be  replaced  by  "good"  or  "acceptable," 

i.  The  assay  should  involve  a  direct  comparison  01  an  un¬ 
known  with  a  standard  in  identical,  concomitant  tests. 

a,  Ideally,  the  two  products  should  be  of  essentially 
equal  potency, 
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2.  There  should  be  a  significant  progressive  relationship 
between  dosage  and  response. 

a,  Linear  following  transformation  as  required. 

b,  Highly  significant  slope. 

c,  No  significant  curvature;  combined  or  opposed, 

3,  Dosage-response  regression  lines  for  the  two  products 
should  be  parallel,  denoting  identity  or  similarity  of  action, 

4.  There  should  he  internal  evidence  of  homogeneity  (of  the 
data)  establishing  validity  of  statistical  analysis  and  adequacy  of 
the  testing  situation. 

5,  Analysis  should  include  an  estimate  of  assay  error  (uncer¬ 
tainty)  calculated  directly  from  the  data. 

Obviously,  not  all  requirements  can  be  applied  to  each  type 
of  assay,  Requirements  pertaining  to  slope  do  not  apply  to  direct' 
assays  |  those  pertaining  to  parallelism  do  not  apply  to  slope -ratio 
assays,  etc,  However,  all  do  apply  to  parallel-line  graded  response 
assays  and  moat  quanta!  response  assays  are  of  similar  design. 

IV,  REDUCTION  OF  UNCERTAINTY  (ERROR)  OF  B1QAS3AYS  . 

All  experienced  bioassayists  are  aware  of  the  innate  uncer-  * 
talnty  and  poor  reproducibility  of  auch  assays  as  a  whole,  The 
degree  of  variability  differs  markedly  with  various  assays,  perhaps 
being  least  with  slope -ratio  assays  and  greatest  with  quanta! 
response  assays,  This  variability  can  be  reduced  to  some  extent 
in  a  variety  of  ways  including: 

1.  Perfection  of  techniques  equipment,  reagents,  etc. 

2.  Control  of  environment;/  constant  temperature;  humidity, 

etc, 

3.  Increased  homogeneity  of  teBt  subjects:  selection  of  strains, 
sex  and  size  of  test  animals;  use  of  litter  mates,  etc. 
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4.  Use  of  restricted  designs:  randomised  Ldocks  (complete  , 
or  incomplete),  Latin  squares,  cross-over  designs,  confounding, 
etc. 

5.  Statistical  adjustment  of  data:  covariance  analysis,  adjust- 
ing  response  data  on  the  bssis  Oi  a  pertinent  associated  measure¬ 
ment. 

6.  Increasing  the  number  of  observations  (test  subjects), 
either  by  using  more  subjects  per  assay  or,  preferably,  by  Inde¬ 
pendent  replication  of  the  assay  as  a  whole. 

In  many  quantal  response  assays,  particularly  assays  of 
vaccines,  antisera,  etc.  ,  most  of  the  above  conventional  approache 
accomplish  only  modest  reduction  in  assay  error.  Slopes  of  the 
dosage -response  regression  lines  characteristically  are  low, 
constituting  a  major  source  of  assay  error,  and  the  main  direct 
compensating  approach  is  to  increase  the  number  of  test  subjects,'* 
A  major  reduction  in  assay  error,  however,  would  require 
impractieally  large  numbers  of  subjects,  Practical  solution  to 
many  of  these  problems  probably  lies  in  the  development  of  assay 
procedures  involving  new  experimental  approaches.  If  some 
meaningful  response  or  attribute  of  the  individual  test  subject  can 
be  measured  as  a  continuous  variable,  a  graded  response-parallel 
line  assay  procedure  should  be  possible.  Typically,  errors  of 
these  assays  are  much  less  than  of  quantal  response  assays,  In 
some  situations,  "time  to  death"  has  shown  promise  as  a  mean¬ 
ingful  quantitative  response  metameter, 

V.  REQUIREMENTS  OF  AN  ADEQUATE  STATISTICAL 
ANALYSIS, 

1.  The  analysis  should  provide  for  the  acceptance  or  rejec¬ 
tion  of  the  assay  results  as  a  whole;  -  such  acceptability  based 

y—  - 

In  simplified  probit  analysis,  a  crude  approximation  of  the  stand¬ 
ard  error  ox  Svi  (log- ratio  of  potency)  is  given  by 

-  J_  .  /IT  I 

8m“  bc  Vnl?  ns 

.  V.  ■ 

where  b  =  combined  (average)  slope,  and  N..  and  N_  =  the  number 
of  test  subjects  assigned  to  the  unknown  and  standard,  respectively 
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upon  the  requirements  outlined  in  part'  III. 

2.  The  analysis  should  provide  for  a  reliable,  unbiased  esti¬ 
mate  of  relative  potency  that  is  independent  of  dosage  throughout 
the  maximum  possible  range. 

3,  The  analysis  should  provide  for  an  estimate  of  assay  uncer  - 
tainty,  -  preferably  expressed  as  confidence  limits  of  the  relative 
potency,  -  provided  meaningful  alternatives  for  action  based  upon 
such  resultant  estimates  can  be  established, 

Of  the  above  requirements,  the  first  is  considered  by  this  writer 
to  be  the  most  essential  and  the  one  most  commonly  unrecognised  or 
neglected  in  routine  analysis  of  bioassay  data,  Specific  computational 
procedures  and  illustrative  examples  for  «J1  the  main  types  of  bio- 
assays  are  given  in  standard  reference  books  such  as  Burn  (2),  Bliss 
(3),  and  Finney  (4,  £). 

VI,  STATISTICAL  ANALYSIS  OF  QUANTAL  RESPONSE 
BIOASSAY  DATA.  A  surprising  number  and  variety  of  computational 
procedures  for  analysis  of  quantal  response  bioassay  data  have  been 
proposed.  In  term*  of  statistical  rigor  and  sophistication,  they 
range  from  simple  "quick-and-dirty"  graphic  approximations  to  for¬ 
mal  iterative  procedures  involving  a  degree  of  complexity  and  tedi¬ 
ous  computational  detail  which  Is  difficult  to  Justify  except,  possibly, 
in  the  most  critically  extenuating  circumstance,  I 

Most,  or  perhaps  all,  of  these  methods  have  some  advantages 
or  disadvantages  dependent  upon  their  contemplated  use  but  any 
critical  comparison  is  far  beyond  the  scope  of  this  presentation,  It 
is  consoling  to  find,  however,  that  they  all  lead  to  closely  similar 
estimates  of  relative  potency  (or  end-points)  when  applied  to  truly 
good  data  a*  defined  in  Part  in.  Unfortunately,  the  simpler  approx¬ 
imate  methods  generally  do  not  provide  a  basis  for  discrimination 
between  acceptable  and  non-acceptable  data  and  when  applied  unwit¬ 
tingly  to ‘truly  unreliable  data  may  yield  estimates  which  are  seri¬ 
ously  misleading. 

The  more  commonly  used  computational  procedures  can  be  class! 
fied  Into  four  general  categories.  These  general  categories,  example 
Of  methods  included  in  each,  and  minimal  comments  regarding  each, 
are  given  below: 
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Class 

Examples 

Comments 

Graphic 

approximations 

Mille  r  -  T  ainte  r 
(6)- 

Minimal  calculations;  ade¬ 
quate  reliability  provided  good 
data;  some  discriminatory 
power  by  inspection. 

Calculated 

approximations 

Reed-Muench 
Behrens  (7). 

Most  widely  uBed  and  proba¬ 
bly  least  reliable  of  all  methods; 
limited  to  estimating  50  Jo 
endpoint. 

Formal 

procedures 

Prohit  analysis; 
Bliss  (8),  Finney 
(5). 

Knudsen-Curtis  (jfc). 

Laborious  calculations!  max- 
imum  reliability  and  discrim¬ 
inatory  power , 

Compromise 

methods 

Litchfield -Wilcoxon 

<i£>- 

Generally  adequate  relia¬ 
bility  and  discriminatory  power; 
appreciably  less  calculations 
than  formal  methods, 

Another  method,  involving  a  factorial^  '  approximation,  is  proposed 
by  this  writer.  This  should  be  considered  a  compromise  method/and  is 
presented  in  some  detail  in  part  VII  of  this  presentation.  j 


The  factorial^  approximation  is  based  essentially  on  analysis  of 
variance  of  quantal  response  data  espressed  in  terms  of  per  tfent  response 
and  log  dose.  When  used  with  data  from  balanced  factorial  bioassays 
involving  a  constant  number  of  test  subjects  per  experimental  unit,  ade¬ 
quate  tests  for  acceptability  of  the  data,  the  relative  potency  estimate  and 
an  approximation  to  confidence  limits  of  the  relative  potency  estimate  can 
be  obtained  with  only  moderately  extensive  calculations.  Analysis  of  the 
data  from  numerous  factorial  quantal  response  bioassays  by  this  method 

ban  yielriod  rpFmltn  in  rlnsp  aarnempnt  with  thnsp  nhtninpH  by  formal  n-rnhit 
analysis  (5)  and  the  Knudsen-Curtis  method  (9). 

VU.  FACTORIAL**  ANAL_Y_S1S_P.F  QUANT  AX,  RESPONSE  BIOASSAY 
DATA  .  In  a  previous  report  (11)  the  essential  computational  details  of 
factorial  analysis  of  attribute  (enumeration)  data,  as  developed  by 
Brandt,  were  presented  together  with  illustrations  of  applications  of  the 
method  to  selected  experiments  in  industrial  chemistry.  Two  forms  of 
the  basic-  formula  were  presented.  The  first  "(Formula  l)11  being  the  form  for 
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calculating  values  of^  for  individual  degrees  of  freedom  from  complete 
factorial  experiments  in  which  the  experimental  units  are  of  equal  sixe, 
was  given  as 

v  2  -Ji  x  XT 

*  [l3"SxF  d 

where  N  =  total  individuals  or  observations;  3  -  total  successes; 

F  «  total  failures;  T  ■  the  total  of  the  sums  of  products  of  factorial 
coefficients  and  the  number  of  successes  in  the  corresponding  experi¬ 
mental  units;  D  *>  the  product  of  the  sums  of  the  squares  of  the  fac¬ 
torial  coefficients  and  the  number  of  individuals  per  experimental 
unit;  and,  the  subscript  in  brackets  indicates  the  degrees  of  free¬ 
dom.  Eith«r  of  the  outcomes  (ye#  or  no,  response  or  non-response, 
survival  or  death,  etc.)  can  be  designated  as  success;  the  other 
outcome  as  failure. 

In  many  instances,  quantal  response  bioassay  data  can  be  sub¬ 
jected  to  factorial^2  analysis:,  the  major  restrictions  being  that 
the  experimental  units  are  of  equal  siee  and  that  successive  doses 
of  ths  independent  variable  (i.  e.  ,  the  toxic  or  protective  aubetance 
being  aseayed)  differ  by  a  constant  interval  when  expressed  in 
appropriate  units  of  measurement.  In  most  (perhaps  all)  assays  of 
immunolaglcally  active  substances,  the  eucceaelve  doses  (levels  of  X) 
ahould  be  increased  or  decreased  in  a  gsometric  eerie*  such  as 
1,  2,  4,  8,  16;  1,  3,9i  27:,  etc.,  as  the  differences  between  the 
logarithms  of  successiv*  doses  are  constant  in  value.  When  these 
restriction*  are  complied  with,  factorial  coefficients  (3)  can  be 
used  directly  in  analysis  of  the  data  and  X2  values  can  be  computed 
by  the  formula  given  above.  In  this  manner  it  is  possible  to  obtain 
statistical  Information  regarding  the  validity  or  adequacy  of  the 
data  (Part  Ill)  and,  at  shown  below,  to  obtain  a  direct  estimate  of 
relative  potency  and  ite  approximate  confidence  limits. 

The  procedures  are  illustrated  with  actual  examples  of  both 
2-dose  (4-l>dint)  and  S-doBC  (6-pnint)  attnyn  nf  mniiia  protec¬ 
tive  potency  of  typhoid  vaccine  performed  by  the  author  at  the  Army 
Medical  Service  Graduate  School.  *  Details  of  the  assay  procedure 
employed  have  been  published  previously  (12);  attention  here  will 
be  limited  primarily  to  statistical  treatment  of  the  data. 


* 

Now  known  as  Walter  Reed  Army  Institute  of  Research, 
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1 .  Factorial 2  analysis  of  a  2-dose  quanta!  response  bioaaeay 
As  a  part  of  a  study  to  determine  the  rep roduc ability  of  mouse 
protection  potency  assays  Of  typhoid  vaccine  (13),  a  eeries  of  6 
assays  were  run  on  identical  aliquots  of  a  reference  vaccine.  The 
aliquotes  were  identified  only  as  A  and  E  and  prior  to  the  assay  it 
was  decided  to  calculate  their  relative  potency,  B  as  per  cent  of  A, 
Data  from  the  sixth  trial  are  reproduced  in  Table  I, 


Table  I 

Two-dose  assay  of  the  mouse  protective  potency  of 
typhoid  vaccines 


For  factorial  analysis,  these  data  are  rearranged  to  the 
form  given  in  Table  IA.  For  purposes  of  obtaining  tests  of  signi¬ 
ficance  (%*)  it  i®  of  no  consequence  in  which  order  the  vaccine* 
are  entered  in  the  table  or  which  comparison  groups  are  assigned  + 
and  -  coefficients ,  However,  in  the  estimation  of  relative  potency, 
■lope,  etc.  ,  computations  are  more  convenient  if  certain  orders 
are  followed.  For  the  comparison  between  products  (designated  a* 
comparison  a),  positive  coefficient*  should  be  assigned  to  the 
"unknown"  (yacein*  B  in  this  case).  Likewise,  for  the  estimation 
of  slope  (comparison  a),  positive  coefficients  should  be  assigned  to 
the  higher  dose  level.  Assignment  of  coefficients  to  the  interaction 
comparison  (ab)  is  uniquely  determined  as  the  cross  products  of 
coefficients  for  the  first  2  comparisons,  of  course.  This  assign¬ 
ment  of  coefficients  is  consistent  with  that  employed  by  Bliss  (3) 
and  other*.  '  il 
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Table  IA 

Factorial  analysis  of  the  data  on  Table  I 


Vaccine 

B 

(unknown) 

A 

(standard) 

Dos* 

Low  High 

I  -  . 

Low  High 

Success  (survivors)  \ 

20 

15 

■  . 

5 

13 

2- 

T 

t2 

D 

T#> 

xz* 

Comparisons 

a  Unknown  vs  standard 

s 

II 

■ 

■ 

17 

18 

-1 

1 

' 

80 

0.0125 

0.05 

b  Slope  (high  vs  low  dose) 

UZ3 

u 

0 

LZJ 

m 

11 

m 

WM 

*b  Departure  from  paral¬ 
lelism  (products  x  doses) 

■ 

II 

■ 

20 

15 

|  5 

25 

80 

O.  3125 

1.  27 

T2  80 2  T2 
XD-“l5^4TXD'B 


4.06 


Evidence  of  assay  validity^  All  calculations  are  performed  in 
the  manner  previously  described  (11),  From  comparison  a,  It  ia  found 
that  the  2  vaccines  do  not  differ  appreciably  in  total  effect  (X  vG  =0.05). 
From  comparison  b  it  can  be  seen  that  there  is  a  highly  significant 
relationship  between  dosage  and  response  (7(2  [l]  =  22,  38),  and  by 
comparison  ab  it  is  determined  that  there  is  no  significant  departure 
from  parallelism  exhibited  by  the  dosage  response  lines  for  the 
unknown  and  standard.  No  information  is  available  concerning  curv¬ 
ature  of  the  dosage  response  curves.  Such  can  be  obtained  only 
when  3  or  more  dosage  levels  are  employed.  . 


As  the  assay  actually  was  conducted,  the  20  mice  in  each  experi¬ 
mental  unit  were  not  handled  as  a  single  group  but  as  4  independent 
groups  of  5  each,  These  groups  were  selected,  assigned  spaces  in  the 
test  room,  immunized  and  challenged  in  random  order  and  the  number 
of  survivors  originally  were  recorded  per  group  of  5.  Thus  it  is 
possible  to  calculate  a  "within  groups"  X  Z  with  12  degrees  of  freedom 


cao  u  lucuouxp  via 


inn  44*«t*  f  i 


ment  4).  The  procedure  will  be  illustrated  with  data  from  the  next 
example  (Table  II). 


Estimation  of  relative  potency, -It  is  possible  to  obtain  an  esti¬ 
mate  of  relative  potency  (RP)  from  the  data  and  calculations  of 
Table  IA  by  use  of  the  formula  for  estimating  relative  potency  from 
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a  2-dose  factorial  assay  as  given  by  Bliss  (3). 

i  x  T 
_  a 


where  M  *  the  log  ratio  of  potency;  i  =  the  log-dose  increment  *; 
and,  Ta  and  are  the  values  in  the  column  headed  T  for  compar¬ 
isons  a  and  b,  respectively.  In  this  assay,  the  dosage  increment 
was  lO-fold,  so  i  »  log  10  =  1.  Ta  =  -1  and  Tfc  *  21.  Substituting 
these  values  in  the  formula,  M  is  calculated  as 

1  x  -1 

M  a  — — —  a  -0.0476. 

JThis  value  is  a  logarithm  and  jrnust  be  converted  to  the  usual  form 
1.9524.  The  antilogarithm  of  1.9524  is  the  relative  potency  which 
is  found  to  be  O.  896;  or,  in  terms  of  percentage,  vaccine  B  is 
89.  6  per  cent  as  potent  as  vaccine  A.  This  estimate  is  in  reason¬ 
ably  close  agreement  with  that  obtained  by  probit  analysis,  85.4 
per  cent. 

Approximate  confidence  limits  of  relative  potency  {  It  also  is 
possible  to  obtain  an  approximation  of  the  confidence  limits  of  the 
relative  potency  estimate  from  the  data  and  calculations  presented 
in  Table  IA,  This  is  most  easily  done  by  first  determining  the 
approximate  confidence  interval  for  M(CI'j^)  which  for  a  2-dose 
assay  is  calculated  as 

r 1.96  x  ZnAfh  x  1  ** 

"  T 

b 

where  n  -  individuals  per  experimental  unit;  N  *  4n  or  grand  total 
individuale,  and  i  and  Tj,  have  the  same  meaning  as  before.  The 

♦Logarithms  of  dosage  increments  from  2-fold  to  lO- fold  are  tabulated 
in  Table!,  Appsndixl  and  designated  as  constants  c  jy1<  z 

♦♦The  term  "confidence  interval"  typically  is  used  to  denote  the  entire 
range  included  betweenlower  and  upper  confidence  limits.  The  quantity 
approximated  by  CI’^,  as  usedhere,  is  one-half  the  entire  range  ex¬ 
pressed  in  logarithmic  units .  Derivationof  this  approximation  is 
given  in  Appendix  II  to  this  paper. 
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95  per  cent  confidence  limits  of  M  then  are  determined  as 

M  +  Cl;. 

and  the  95  per  cent  confidence  limits  of  the  relative  potency 
(95%  CL^p)  are  found  as  the  antilogarithms  of  these  2  values. 

95%  CJL,Rp  *  antilogarithms  of  M-CI^  and  M+CI,^. 


M 


M’ 


These  limits  will  be  in  the  form  of  ratios  which  can  be  converted 
to  percentage  by  multiplying  by  100.  For  the  illustrative  problem 
dealt  with  here  (Tables  I  and  IA) 

CIM  °  1  *  lQg  10  =  0.4174 


Then 

95%  CLm  -  -0,  0476  +  0.4174  -  -0, 4650  and  0.  3698 
-  1.5350  and  0.  3698 

Taking  antilogarithms 

95%  CLRp  «  0.  34  and  2.  34 
or  .  34%  and  234%. 

Thus,  the  beat  estimate  of  relative  potency  (Baa  per  cent  of  A)  is 
89.  6  per  cent  and  the  odds  are  approximately  19  out  of  20  that  the 
true  potency  is  between  34  and  234  per  cent. 


For  a  factorial  assay  of  set  design,  where  i  and  n  are  constant, 

assay  to  assay,  the  foregoing  calculation!  eati  be  simplified  as  all 


elements  in  the  formula  for 


CI^  will  be  the  same 
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except  for  T  ,  Tims  constants  for  2-dose  assays  (C  )  and  3„ 

dose  assays  (C^  for  fold-increments  of  dosage  from  2  to  lO, 

and  for  values  of  n  from  lO  to  20,  have  been  calculated  and  are 
presented  in  Appendix  I,  Tables  2  and  3. 

It  must  be  emphasized  that  this  estimate  of  th«  confidence 
limits  of  the  relative  potency  is  only  an  approximation.  Yet  the 
results  obtained  were  in  reasonably  .clo so, „a,g.jre^mdnt' -with  these  , 
obtained  by  probit  analysis,  31.  6  and  230.4  per  cent, 

2 

2.  Factorial  %  analysis  of  a  3-dose  quantal  response  bloassay. 

Factorial  analysis  of  a  3-dose  quantal  response  assay  for  deter * 
mining  the  validity  of  the  assay  and  the  estimation  of  relative  potency 
and  approximate  95/o  confidence  limits  of  the  potency  estimate,  are 
illustrated  with  data  from  another  typhoid  vaccine  mouse  protection 
potency  test  performed  at  the  Army  Medical  Service  Graduate 
School,  The  vaccines  tested  were  a  routine  production  lot  (unknown) 
and  a  reference  atandard,  fie  suite  of  the  assay  are  summarised  in 
Table  II,  and  are  arranged  in  the  form  suitable  for  factorial  X 
analysis  in  Table  UA, 

Table  II 

Three-dosa  assay  of  the  mouse  protective  potency 
of  an  unknown  typhoid  vaccine  in  respect  to  a  standard 


(Survivor  s /totals) 


Vaccine 

Vaccine  dose  (ml) 

0.02 

Q,  08 

0.32 

Unknown 

l/lO 

s/lO 

8/lO 

\/}° . - 

7/10 

- . 9/10 

Standard 

2/16 

4/10  1 

b/Io 

1/iO 

5/10 

7/10 

J - — — . . U— , . . 1 
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Table  II A 

Factorial  X 2  analysis  of  the  data  of  Table  II 


Vaccine 

Unknown 

Standard 

Dose 

Pi 

1 

l 

d2 

5 

? 

L°3| 

8 

9 

°1 

02 

P3 

"2 

1 

5 

II 

Successes/ 20 

2 

12 

17 

3 

9 

15 

m 

m 

WxBFi 

Wi 

P 

mat 

1 E&m 

Compiriioni  ^ 

a  Unknown  vs  standard 

+ 

\r 

1 

B 

H 

l6 

120 

0.13 

b  Slope . 

m 

Ri 

m 

m 

El 

n 

m 

m 

m 

EEEI 

iffTWl 

Effil 

ab  Parallelism _ _ 

m 

tm 

m 

El 

I#1 

m 

So 

1 0 

nr 

mn 

®i 

Oj 

0.11 

0.44 

n 

m 

m 

n 

m 

n 

mi 

m 

tm 

240 

0.10 

0.40 

a 

I 

| 

n 

m 

El 

UJ 

+2  | 

L-J 

37_ 

m 

m 

tm 

240 

0.10 

0,40 

*  2 
X  s 


N2 

sTf  x 


TZ_  1202  ..  T2 

d  "fee  x  62  "ET 


a  4 .  OO  x 


Between  groups  within  experimental  unites 
\2 


X2®.  4. 


OO  *  H-D4  *  (7-5)2  ♦  8  -8)2  t*(a-l.)Z  +  (5-«)2  t,(8-7)Z 
Y  20 


«4,OOx 


20 


®  1.  60. 


There  is  littlfj  need  for  comment  regarding  the  computational 
procedure  employed,  Factorial  coefficients  were  assigned  in  con- 
ventlonah  ordfljr  Qj)  and  “Xj  values  for  each  comparison  were  com¬ 
puted  in  the  manner  previously  described,  Calculation  of  X2 
"between  groups  within  experimental  units"  was  accomplished  by 
summation  of  ail  T2/D  values  between  .pairs  of  groups  of  10  each 
and  multiplying  the  total  by  the  constant  N2 

..  I  SxF 

Evidence  of  validity  ..  4, 


There  w«»  no  evidence  of  significant  differences  between  the 
pairs  of  groups  within  Experimental  units  (x,2BQe  60).  This 
yields  assurance  that  the  randomization  procedures  employsd  dur¬ 
ing  the  assay  were  adequate  to  prevent  appreciable  bias  due  to  tech¬ 
nical  and  environmental  factors.  Since  3  dosage  levels  of  vaccine 
were  employed,  it  was  possible  to  gain  information  regarding  curva 
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ture  of  the  dosage  response  lines,  both  combined  and  in  opposition. 
There  was  no  evidence  of  systematic  departure  from  linearity. 
Thus,  all  requirements  for  assay  validity  (Part  111)  were  satisfied. 

Estimation  of  relative  potency 


The  relative  potency  of  the  unknown  in  respect  to  the  standard 
was  estimated  by  the  formula  given  by  Bliss  (3][  for  calculating  M 
in  3-dose  factorial  assays 

4  x  i  x  Ta  * 

M  a  - - 

3  x  Tfa 

The  dosage  increment  employed  in  this  assay  was  4 -fold,  so 
la  log  4  =  0,  6021.  Substituting  calculated  values  of  T  and  T; 

Into  the  formula,  M  was  calculated  as 


4  x  0,  6021  x  4 
3  x  27 


a  0;il89 


and  the  relative  potency  3  lUU  x  antilog  0. 1189  3  131,  5  per  cent. 
Approximate  confidence  limits  of  relative  potency 


The  formula  lor  estimating  the  approximate  confidence  inter¬ 
val  of  M,  in  a  3-dose  assay  differs  from  that  for  2-dose  assay  only 
in  that  4n  must  be  substituted  for  2n,  Thus,  for  a  3-dose  factor¬ 
ial  assay, 

Cl. .  «  1,  96  x  4n/*/r>T  x  1 


#  Values  ofJ-JSJLdoeage  increments  of  2-iold  through  lO-foid  have 
been  calculated  and  are  given  as  constants  &*.  „  in  Table  1,  Appen¬ 
dix  1.  M  is  determined  by  multiplying  the  ratio  ^T/T^  by  the  appro¬ 
priate  value  of  c.  .  (0 .  8020  in  thim  «v«mnl*5 

-  M,  J  '  r . r'  ' 
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For  the  data  dealt  withhereJ,Tablea  II  and  HA),  n  =  20,  N  =  120, 
and  i  =  log  4  =  O,  6021,  Then 

,  1,  96  x  80ATl20  x  O.  6021  * 

C  Ivf  27 

=  O,  3192, 

The  confidence  limits  of  M  are  found  as 
95  %  CLm  =  M  *  CfM 

b  0.1189  t  O.  3192  f  -O.  2003  and  0.4381 
» T,  7997  and  0.4381 

Than  the  95  par  cant  confidence  limits  of  the  relative  potency  are 
obtained  as  the  antilogarithms  of  these  values, 

95%  CL  -  O,  63  and  2,  74 
or  ^  ■  63  and  274  per  cent 

These  data  also  were  analysed  by  the  probit  analysis,  The 
relative  potency  estimate  was  132,  2  par  cent  and  the  95  per,  cent 
confidence  limits  were  64,  2  per  cent  and  272,  2  per  cent. 

3.  Return^  of  computational  procedure:  Chi  square  analysis 
of  quantal  response  factorial  assays  yielding  (1)  statistical  evidence 
regarding  reliability  of  the  data,  (2)  an  estimate  of  relative  potency, 
and  (3)  approximate  confidence  limits  of  the  relative  potency, 
involves  a  series  of  7  main  steps, 

1,  Arrange  the  data  on  a  work  sheet  of  the  form  used  in 
Tables  1A  and  II A. 

2..  Assign  the  factorial  coefficients  in  accordance  with  the 
Actual  design  of  the  experiment.  Compute  N-^/SlxF  from  the  grand 

^Constants  c.  ,  for  estimating  values  of  CI^  in  3-dose  factorial 
assays  for  dosage  increments  of  2-fold  through  10-  fold  and  for 
values  of  n  from  lO  through  20,  have  been  calculated  and  are  given 
in  Table  3  o£  the  appendix*  For  inis  problem,-  C|  o.  uib3.  This 
divided  by  27  (T^)  =  O.  3192,  the  same  as  calculated  above. 
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2  2  2 

totals  and  then  2 +,  21 T,  T  ,  D,  T  /D  and  "X,  '  for  each  compari¬ 
son  (row).  Also,  if  data  on  subgroups  within  experimental  units  are 
available,  calculate  the  "between  groups"  ”X^  (cf.  Table  HA).  From 
the  various  values  of  7(^  determine  if  there  la  sufficient  evidence 
oi*  validity  to  justify  estimation  of  potency. 

3.  If  justified,  compute  the  ratio  T  /T.  and  calculate  M  as; 

fir  0 

a,  Two  dose  assay:  M  =  i  s  T^/T^A  Values  of  1  are 
given  as  the  constants  c  In  Tabled,  Appendix  I. 

WL«  L  v 

b.  Three-do 

4x1  are 

'3 

Appendix 


se  assay:  M  ® • 


x  T  yT.  I  Values  of 
a'  b 


given  as  the  constants  c. .  in  Table  1, 


4.  Determine  the  relative  potency  (RP)  as  a  r»\io  or  per¬ 
centage  as  antilog  M,  or  a*  1  00  x  antilog  M,  respectively, 

5.  Compute  Clj^  as: 

a.  Two-dose  assay: 

rT/  1  ■  96  x  Zn/N  x  i 

WM'  T, 

b. 

or,  using  constants  Cj  ^  from  Table  2,  Appendix  Is 


■;i 
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,  7.  Determine  the  95  per  cent  confidence  limits  of  the 
relative  potency  \is  -  . 

95%  CL„p  .  antilog  ^  ^  ^ 

v  ■  ■  ■  ■  . 

It  it  is  desired  to  express  the  limits  as  percentages,  mul¬ 
tiply  each  value  by  lOO, 


i 
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••  APPENDS  I 

I  Table  1 


Values  of  cM  2  and  far  obtaining  estimates  of  M, 

the  log  ratio  of  potency,  from  2 -dose  and  3-dose  factorial  assays 


|  *  Relative  potency  »  antilog  M.  '> 

fe  . .  .  ■  ■  -  ■ .  ’ 

f  Relative  potency  in  %  =  10b  x  antlio.fi  M. 

r  :•  P  ••  ~ 
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APPENDIX  II 


Approximation  of  the  Confidence  Interval  of  lyi 

The  standard  error  of  M  (e^)  from  a  balanced  factorial 
bioassay  ie  given  by  Bliss  (3)  as;  (J  \ 


M 


c- 


,nr~ 

r  r»2  '  n 

|l+  b7-  -~~sTtT 

L  .  .  1  -* 

where  =  meknssquare  between  products;  =  mean  square  for 
combined  slope;  «2  »  mean  square;  t  e  Strident1  B  statistic;  N  •  . 
total  number  of  teat  subjects  (possible  responses);  and  b  is  the 
combined  or  average  slope  of  the  dose-response  regression  line, 


'  V,  !/ 


Tb 


2  x  i  x  n 


For  a  2-dos:*  (4-point)  assay,  be  is  estimated  as 
for  a  3“dose  (6-point)  assay,  as  Tb  ,  In  these, 

4  x  i  x|T  "  " 

Tb  is  found  as  shown  ifl'  Tables  IA  and  HA,  i  i#  the  log  ratio  >qI  dosage 
increment,  and  n  is  the  number  of  text  subjects  per  experimental 
group.  '  '  '  ’  /.-V 

In  a  good  bioastay  (statiatlcaily  acceptable),  D  wiLl  be.,  small 
and  will  be  large..  Thus,  the  quantity  enclosed  in  brackets  ,  " 
approaches  unity  and  can  be  ignored.  In  the  binomial’;  the  variance 
( 8“)  hha  a  maximum  value  of  O.  2D  and  a  hus  a  maximum  value 
of  O.  5.  In  a  balanced  assay  of  fixed  design,  N  will  he  4n  or  6n  for 
a  2-do»e  and  3-do*e  assay,  respectively.  Substituting  the  appro¬ 
priate  formula  for  bf  ao  given  above,  .and  introducing  t*  *  1.  96, 
the  confidence  Intervals  of  M  can  bt,  reduced  to  the  following 
approximations; 


Cl 

2 -dose  assay;  M 


(1,06  x  2n  x  i)/  fhT 
T, 


Vf 


3-dose  assay:  C*M  = 


These  approximations  we used  for  calculating  the  constants 
presented,  in  Tables  2  and  3  of  Appendix  I. 
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